-- Logs begin at Wed 2022-08-10 10:21:44 UTC, end at Wed 2022-08-10 11:51:04 UTC. -- Aug 10 11:13:54.726153 dv-cinder-850618-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 11:13:54.733427 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 11:13:54 2022] *** Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: nodename: dv-cinder-850618-2-iscsi Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: machine: x86_64 Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: clock source: unix Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: pcre jit disabled Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: detected number of CPU cores: 4 Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: current working directory: / Aug 10 11:13:54.735968 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: detected binary path: /usr/bin/uwsgi-core Aug 10 11:13:54.736586 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: your processes number limit is 47680 Aug 10 11:13:54.736586 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: your memory page size is 4096 bytes Aug 10 11:13:54.736586 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: detected max file descriptor number: 2048 Aug 10 11:13:54.736586 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: lock engine: pthread robust mutexes Aug 10 11:13:54.736807 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: thunder lock: enabled Aug 10 11:13:54.737091 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 11:13:54.737186 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 11:13:54.776886 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: Python main interpreter initialized at 0x563ad9a869c0 Aug 10 11:13:54.776886 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: python threads support enabled Aug 10 11:13:54.776886 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: your server socket listen backlog is limited to 100 connections Aug 10 11:13:54.776886 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: your mercy for graceful operations on workers is 90 seconds Aug 10 11:13:54.777271 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 11:13:54.777356 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: *** Operational MODE: preforking *** Aug 10 11:13:54.777554 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: *** uWSGI is running in multiple interpreter mode *** Aug 10 11:13:54.777554 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: spawned uWSGI master process (pid: 103930) Aug 10 11:13:54.777754 dv-cinder-850618-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 11:13:54.779950 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: spawned uWSGI worker 1 (pid: 103931, cores: 1) Aug 10 11:13:54.779950 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: spawned uWSGI worker 2 (pid: 103932, cores: 1) Aug 10 11:13:54.779950 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 11:13:55.442297 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:13:55.456081 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:13:56.537358 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:13:56.537358 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: from cryptography.utils import int_from_bytes Aug 10 11:13:56.537944 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:13:56.537944 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: from cryptography.utils import int_from_bytes Aug 10 11:13:56.559098 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:13:56.559098 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: from cryptography.utils import int_from_bytes Aug 10 11:13:56.559618 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:13:56.559618 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: from cryptography.utils import int_from_bytes Aug 10 11:13:59.054542 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:13:59.055122 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:13:59.055467 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:13:59.055544 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:13:59.055611 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:13:59.055677 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:13:59.055741 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:13:59.055816 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:13:59.055883 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:13:59.056098 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:13:59.056347 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.056489 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.056623 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.056816 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.056915 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.057139 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.057239 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.057462 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.057579 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.057796 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.057893 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.058106 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.058191 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.058427 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.058513 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.058749 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.058833 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.059007 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.059093 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.059321 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.059414 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.059635 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.059726 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-2-iscsi {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.059953 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.060066 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-2-iscsi {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.060286 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.060380 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.060593 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.060677 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.060901 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.060996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.061202 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.061287 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.061508 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.061591 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.061812 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.061906 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.062125 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.062302 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.062673 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.063756 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.063842 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.063918 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.063984 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.064089 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.064210 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.064356 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.064547 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.064669 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.064862 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.064990 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.065426 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.065550 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.065754 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.065848 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.066063 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.066182 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.066400 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.066498 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.066699 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.066846 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-2-iscsi {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.067095 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-2-iscsi {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.067185 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.067411 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.067502 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.067723 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.067828 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.068058 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.068211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.068466 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.068561 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.068774 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.068936 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.069095 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.069212 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.069404 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.069510 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.069712 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.069804 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.070030 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.070116 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.070351 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.070446 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.070669 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.070769 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.070985 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.071071 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.071286 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.071374 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.071593 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.071677 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.071899 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.072038 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.072247 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.072345 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.072552 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.072648 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.072861 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.072959 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.073113 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.073207 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.073412 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.073497 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.073720 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.073822 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.074039 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.074126 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.074358 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.074440 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.074611 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.074716 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.074860 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.074950 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.075155 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.075249 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.075472 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.075567 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.075779 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.075865 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.076111 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.076203 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.076418 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.076516 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.076722 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.076816 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.077026 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.077121 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.077329 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.077416 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.077634 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.077719 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.077938 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.078032 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.078282 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.078373 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.078596 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.078775 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.078916 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.079168 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.079257 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.079496 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.079589 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.079808 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.079902 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.080164 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.080265 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.080508 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.080595 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.080804 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.080909 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.081115 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.081208 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.081449 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.081536 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.081768 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.081863 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.082075 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.082166 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.082385 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.082481 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.082689 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.082788 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.082996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.083083 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.083297 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.083383 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.083602 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.083702 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.083917 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.084042 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.084193 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.084280 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.084495 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.084629 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.084799 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.084892 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.085095 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.085180 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.085403 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.085501 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.085708 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.085795 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.086036 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.086128 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.086333 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.086420 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.086640 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.086725 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.086940 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.087026 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.087242 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.087328 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.087544 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.087630 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.087848 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.087940 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.088175 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.088270 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.088479 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.088611 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.088780 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.088874 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.089081 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.089166 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.089383 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.089474 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.089687 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.089794 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.089997 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.090084 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.090302 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.090397 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.090605 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.090700 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.090907 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.091071 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.091209 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.091304 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.091520 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.091639 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.091824 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.091916 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.092157 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.092266 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.092461 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.092556 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.092766 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.092860 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.093069 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.093159 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.093371 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.093465 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.093675 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.093759 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.094023 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.094177 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.094312 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.094457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.094616 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.094760 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.094916 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.095014 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.095221 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.095317 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.095525 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.095611 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.095828 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.095914 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.096151 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.096239 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.096456 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.096544 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.096755 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.096840 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.097071 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.097160 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.097355 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.097449 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.097652 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.097748 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.097953 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.098039 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.098251 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.098391 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.098567 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.098655 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.098871 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.098965 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.099175 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.099269 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.099478 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.099573 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.099783 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.099877 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.100123 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:13:59.100217 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.100458 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.100558 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.100783 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.100873 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.101115 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.101211 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.101427 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.101525 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.101756 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.101842 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.102070 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.102157 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.102385 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.102480 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.102698 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.102784 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.103011 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.103096 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.103323 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.103419 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.103633 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.103719 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.103947 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.104058 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.104290 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.104377 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.104609 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.104715 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.104926 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.105015 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.105244 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.105333 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.105559 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.105644 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.105871 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.105958 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.106189 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.106276 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.106502 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.106588 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.106819 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.106905 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.107129 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.107223 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.107456 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.107543 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.107770 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.107865 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.108135 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.108229 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.108465 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.108554 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.108786 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.108885 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.109096 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.109183 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.109933 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.110040 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.110246 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.110430 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.110555 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.110860 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.110950 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.111185 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.111284 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.111518 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.111606 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.111831 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.111924 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.112178 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.112265 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.112493 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.112579 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.112807 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.112907 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.113118 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.113282 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.113432 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.113517 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.113744 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.113829 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.114075 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.114168 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.114389 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.114480 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.114702 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.114804 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.115015 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.115178 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.115321 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.115453 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.115627 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.115766 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.115938 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.116121 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.116269 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.116357 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.116573 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.116659 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.116879 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.116984 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.117182 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.117267 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.117485 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.117571 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.117788 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.117875 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.118107 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.118194 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.118413 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.118544 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.118728 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.118816 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.119040 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.119133 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.119352 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.119438 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.119663 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.119751 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.119971 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.120121 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.120300 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.120399 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.120605 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.120691 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.120914 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.121008 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.121222 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.121319 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.121524 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.121611 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.121843 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.121937 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.122151 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.122258 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.122454 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.122547 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.122765 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.122859 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.123070 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.123167 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.123375 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.123463 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.123684 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.123778 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.123990 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.124108 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.124322 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.124633 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.124719 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.124946 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.125067 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.126326 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.126424 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.126506 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.126584 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.126675 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.126754 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.126832 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.126908 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.127126 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.127233 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.127433 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.127522 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.127758 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.127845 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.128105 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.128209 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.128415 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.128504 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.128719 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.128815 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.129022 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.129118 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.129326 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.129413 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.129627 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.129713 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.129928 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.130027 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.130228 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.130315 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.130530 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.130618 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.130832 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.130927 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.131133 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.131226 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.131437 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.131538 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.131738 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.131826 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.132075 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.132164 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.132384 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.132486 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.132689 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.132792 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.132990 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.133077 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.133303 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.133391 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.133625 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.133716 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.133937 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.134032 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.134276 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.134362 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.134598 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.134687 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.134915 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.135031 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.135226 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.135329 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.135537 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.135623 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.135845 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.135981 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.136190 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.136298 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.136491 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.136579 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.136802 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.136889 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.137116 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.137257 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.137428 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.137515 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.137738 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.137831 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.138045 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.138141 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.138352 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.138438 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.138669 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.138798 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.138977 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.139077 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.139282 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.139369 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.139589 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.139675 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.139907 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.140014 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.140267 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.140353 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.140585 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.140706 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.140937 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.141126 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.141252 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.141596 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.141708 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.141907 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.142005 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.142232 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.142336 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.142528 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.142628 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.142840 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.143008 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.143156 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.143244 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.143461 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.143555 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.143779 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.143878 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.144110 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.144212 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.144430 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.144523 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.144738 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.144825 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.145055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.145149 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.145363 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.145453 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.145674 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.145762 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.146010 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.146112 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.146290 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.146378 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.146611 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.146713 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.146920 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.147008 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.147233 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.147327 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.147542 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.147641 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.147851 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.147945 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.148185 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.148285 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.148490 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.148579 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.148794 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.148881 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.149098 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.149192 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.149405 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.149492 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.149713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.149811 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.150023 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.150120 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.150328 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.150416 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.150635 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.150728 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.150939 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.151035 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.151241 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.151327 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.151549 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.151666 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.151850 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.151947 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.152185 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.152291 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.152496 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.152591 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.152816 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.152910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.153128 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.153229 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.153431 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.153523 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.153736 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.153830 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.154046 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.154142 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.154350 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.154443 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.154652 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.154745 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.154955 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.155049 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.155275 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.155375 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.155555 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.155648 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.155858 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.155950 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.156211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.156362 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.156871 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.156978 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.157058 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.157136 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.157212 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.157451 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.157540 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.157763 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.157849 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.158073 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.158159 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.158387 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.158472 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.158699 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.158798 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.159009 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.159115 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.159319 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.159405 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.159630 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.159715 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.159937 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.160063 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.160276 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.160360 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.160588 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.160682 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.160896 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.160989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.161205 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.161296 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.161512 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.161596 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.161818 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.161925 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.162125 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.162218 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.162434 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.162517 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.162739 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.163000 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.163086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.163332 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.163417 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.163647 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.163901 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.163986 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.164263 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.164348 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.164583 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.164669 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.164904 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.164997 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.165225 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.165310 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.165547 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.165632 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.165855 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.165958 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.166178 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.166272 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.166465 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.166552 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.166771 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.166865 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.167082 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.167170 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.167387 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.167477 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.167693 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.167786 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.168008 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.168098 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.168321 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.168407 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.168624 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.168709 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.168927 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.169027 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.169229 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.169329 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.169527 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.169625 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.169829 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.169914 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.170130 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.170215 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.170431 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.170523 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.170733 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.170817 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.171033 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.171117 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.171345 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.171438 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.171646 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.171731 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.172613 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173125 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173231 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173322 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173402 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173480 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173557 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173642 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173817 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.173917 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.174144 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.174239 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.174485 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.174572 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.174795 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.174883 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.175111 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.175198 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.175421 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.175506 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.175727 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.175815 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.176048 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.176138 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.176355 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.176458 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.176663 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.176758 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.176970 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.177075 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.177273 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.177367 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.177581 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.177666 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.177886 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.177973 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.178190 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.178289 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.178496 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.178580 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.178798 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.178892 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.179106 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.179199 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.179406 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.179532 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.179708 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.179795 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.180037 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.180138 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.180338 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.180422 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.180638 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.180729 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.180944 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.181036 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.181249 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.181335 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.181548 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.181631 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.181855 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.181983 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.182155 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.182240 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.182455 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.182539 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.182760 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.182846 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.183060 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.183191 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.183361 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.183444 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.183667 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.183753 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.183972 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.184122 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.184296 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.184394 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.184603 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.184687 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.184910 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.184998 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.185211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.185304 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.185516 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.185601 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.185825 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.185910 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.186128 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.186220 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.186428 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.186513 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.186735 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.186820 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.187039 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.187134 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.187343 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.187434 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.188671 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.188785 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.188881 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.188961 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.189039 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.189117 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.189237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.189323 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.189542 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.189632 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.189850 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.189935 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.190153 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.190508 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.190716 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.190804 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.191016 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.191102 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.191320 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.191406 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.191623 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.191709 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.191923 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.192067 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.192254 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.192353 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.192558 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.192651 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.192864 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.192949 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.193166 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.193262 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.193470 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.193554 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.193775 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.193869 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.194092 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.194192 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.194420 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.194508 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.194726 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.194811 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.195048 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.195146 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.195360 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.195447 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.195671 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.195756 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.195988 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.196112 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.196317 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.196403 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.196629 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.196713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.196939 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.197027 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.197243 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.197341 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.197545 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.197632 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.197851 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.197938 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.198161 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.198246 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.198466 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.198551 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.198771 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.198857 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.199091 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.199189 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.199402 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.199487 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.199715 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.199818 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.200045 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.200211 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.200371 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.200465 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.200682 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.200769 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.200986 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.201080 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.201294 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.201388 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.201602 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.201686 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.201910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.201994 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.202218 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.202311 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.202527 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.202612 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.202836 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.202922 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.203165 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.203316 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.203846 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.203936 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.204063 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.204145 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.204237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.204398 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.204484 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.204710 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.204802 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.205020 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.205115 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.205327 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.205426 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.205634 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.205718 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.205946 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.206040 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.206249 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.206334 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.206559 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.206645 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.206865 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.206958 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.207173 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.207292 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.207478 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.207606 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.207905 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.208040 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.208237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.208324 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.208548 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.208632 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.208856 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.208944 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.209168 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.209254 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.209479 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.209563 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.209783 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.209871 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.210098 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.210183 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.210404 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.210490 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.210798 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.210892 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.211112 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.211197 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.211418 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.211515 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.211723 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.211809 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.212053 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.212142 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.212365 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.212472 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.212673 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.212758 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.212980 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.213066 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.213285 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.213379 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.213590 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.213682 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.213897 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.213982 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.214217 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.214310 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.214519 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.214634 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.214840 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.214932 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.215244 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.215330 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.215555 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.215661 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.215861 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.215975 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.216303 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.216391 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.216618 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.216704 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.216931 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.217017 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.217252 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.217341 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.217560 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.217646 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.217874 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.217988 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.218178 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.218264 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.218493 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.218581 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.218830 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.219080 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.219529 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.219619 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.219709 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.219786 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.219853 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.219980 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.220089 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.220333 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.220422 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.220658 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.220745 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.220975 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.221061 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.221298 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.221385 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.221618 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.221709 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.222021 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.222112 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.222332 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.222426 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.222647 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.222733 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.222969 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.223054 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.223275 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.223361 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.223580 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.223666 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.223887 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.223986 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.224213 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.224301 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.224519 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.224604 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.224828 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.224923 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.225138 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.225223 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.225451 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.225535 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.225759 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.225851 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.226070 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.226156 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.226373 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.226459 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.226676 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.226769 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.226984 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.227077 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.227286 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.227380 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.227602 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.227688 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.227914 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.228023 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.228257 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.228352 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.228575 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.228661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.228881 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.228967 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.229189 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.229275 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.229498 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.229591 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.229803 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.229931 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.230108 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.230195 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.230412 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.230498 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.230719 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.230815 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.231041 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.231136 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.231356 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.231441 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.231679 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.231766 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.232037 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.232140 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.232334 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.232421 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.232660 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.232755 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.232984 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.233078 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.233302 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.233392 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.233615 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.233720 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.233935 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.234023 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.234237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.234322 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.235087 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.235559 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.235667 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.235750 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.235829 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.235907 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.235984 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.236177 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.236275 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.236484 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.236580 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.236794 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.236881 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.237100 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.237232 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.237404 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.237500 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.237707 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.237805 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.238030 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.238125 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.238334 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.238419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.238656 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.238741 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.238963 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.239058 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.239266 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.239358 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.239567 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.239653 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.239867 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.239960 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.240231 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.240326 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.240533 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.240619 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.240860 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.240946 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.241167 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.241253 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.241488 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.241583 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.241801 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.241887 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.242113 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.242198 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.242426 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.242523 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.242740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.242830 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.243053 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.243137 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.243364 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.243459 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.243676 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.243768 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.243981 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.244086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.244315 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.244480 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.244629 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.244715 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.244943 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.245048 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.245460 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.245554 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.245789 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.245876 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.246100 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.246185 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.246411 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.246503 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.246719 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.246805 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.247033 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.247129 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.247344 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.247430 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.247651 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.247737 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.247960 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.248075 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.248290 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.248429 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.248599 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.248689 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.248923 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.249018 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.249244 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.249329 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.249565 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.249718 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.249899 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.250014 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.251016 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.251180 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.251263 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.251351 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.251431 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.251568 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.251728 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.251885 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.252111 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.252274 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.252440 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.252592 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.252729 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.252899 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.253042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.253212 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.253356 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.253527 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.253671 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.253842 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.253985 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.254155 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.254299 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.254466 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.254612 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.254780 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.254926 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.255094 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.255238 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.255403 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.255548 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.255719 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.255861 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.256056 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.256200 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.256371 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.256524 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.256696 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.256856 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.257029 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.257175 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.257349 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.257488 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.257662 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.257800 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.257976 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.258114 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.258291 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.258635 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.258808 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.258952 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.259122 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.259285 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.259454 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.259610 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.259777 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.259933 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.260124 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.260279 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.260443 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.260596 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.260759 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.260921 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.261083 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.261226 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.261387 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.261530 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.261691 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.261841 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.261999 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.262148 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.262305 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.262449 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.262609 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.262774 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.262929 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.263084 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.263236 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.263387 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.263539 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.263704 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.263854 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.264091 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.264185 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.264625 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.264714 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.264970 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.265056 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.265288 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.265381 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.265613 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.265720 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.265970 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.266384 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.266456 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.266543 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.266631 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.266709 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.266879 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.266968 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.267186 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.267281 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.267490 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.267617 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.267804 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.267891 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.268140 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.268242 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.268445 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.268532 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.268748 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.268838 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.269057 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.269152 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.269366 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.269451 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.269665 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.269757 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.269973 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.270060 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.270276 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.270359 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.270598 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.270693 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.270901 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.270994 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.271203 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.271290 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.271506 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.271591 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.271815 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.271912 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.272142 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.272247 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.272448 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.272540 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.272753 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.272839 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.273055 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.273151 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.273363 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.273459 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.273667 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.273753 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.273974 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.274060 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.274281 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.274379 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.274588 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.274674 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.274893 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.274977 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.275198 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.275295 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.275500 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.275586 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.275820 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.275919 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.276150 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.276251 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.276504 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.276591 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.276819 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.276903 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.277128 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.277229 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.277448 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.277533 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.277759 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.277843 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.278071 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.278157 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.278416 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.278501 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.278729 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.278813 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.279258 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.279346 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.279589 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.279673 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.279909 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.280022 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.280267 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.280363 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.280599 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.280685 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.280908 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.281005 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.281213 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.281323 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.281783 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.281885 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.282041 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.282202 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.282284 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.282370 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.282456 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.282598 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.282743 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.282911 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.283053 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.283225 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.283361 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.283540 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.283658 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.283852 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.283969 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.284193 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.284303 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.284507 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.284608 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.284820 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.284906 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.285133 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.285226 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.285445 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.285540 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.285758 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.285851 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.286070 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.286162 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.286381 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.286484 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.286698 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.286786 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.287022 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.287113 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.287340 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.287433 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.287654 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.287739 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.287969 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.288098 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.288301 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.288388 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.288611 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.288696 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.288917 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.289001 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.289227 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.289313 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.289539 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.289625 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.289859 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.289953 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.290169 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.290257 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.290474 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.290560 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.290782 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.290885 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.291188 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.291317 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.291504 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.291589 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.291822 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.291916 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.292156 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.292245 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.292473 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.292559 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.292794 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.292880 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.293105 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.293192 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.293416 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.293500 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.293725 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.293811 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.294038 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.294123 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.294368 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.294463 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.294691 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.294777 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.295014 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.295101 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.295320 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.295415 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.295631 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.295719 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.295949 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.296059 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.296296 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.296394 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.296608 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.296693 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.297447 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.297584 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298072 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298171 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298253 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298331 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298416 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298536 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298623 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298851 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.298945 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.299159 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.299254 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.299464 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.299560 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.299769 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.299854 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.300096 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.300186 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.300403 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.300499 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.300707 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.300840 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.301011 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.301096 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.301314 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.301457 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.301614 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.301699 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.301915 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.302008 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.302216 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.302309 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.302520 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.302606 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.302822 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.302906 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.303120 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.303207 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.303421 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.303514 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.303726 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.303813 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.304050 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.304139 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.304384 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.304470 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.304749 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.304841 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.305013 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.305107 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.305334 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.305419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.305646 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.305732 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.305965 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.306050 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.306274 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.306359 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.306586 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.306684 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.306895 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.306990 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.307208 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.307293 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.307517 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.307611 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.307827 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.307912 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.308161 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.308251 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.308472 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.308569 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.308779 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.308866 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.309088 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.309179 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.309397 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.309486 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.309707 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.309793 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.310016 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.310101 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.310342 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.310430 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.310645 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.310737 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.310966 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.311052 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.311280 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.311376 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.311594 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.311689 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.311905 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.312027 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.312242 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.312339 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.313152 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.313700 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.313700 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.313867 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.313953 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.314038 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.314117 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.314194 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.314373 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.314469 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.314687 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.314773 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.315003 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.315091 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.315582 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.315672 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.315896 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.315983 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.316241 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.316328 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.316558 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.316647 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.316868 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.316961 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.317194 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.317281 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.317504 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.317590 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.317828 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.317914 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.318154 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.318241 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.318495 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.318581 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.318806 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.318899 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.319127 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.319270 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.319441 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.319528 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.319747 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.319833 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.320041 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:13:59.320145 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.320383 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:13:59.320627 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:13:59.473754 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO dbcounter [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Registered counter for database nova_api Aug 10 11:13:59.474955 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO dbcounter [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Registered counter for database nova_api Aug 10 11:13:59.495154 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_db.sqlalchemy.engines [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:13:59.496601 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_db.sqlalchemy.engines [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:13:59.502098 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writer thread running {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:13:59.503198 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writer thread running {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:13:59.558455 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.context [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12429ae4-bffe-42b6-ae28-ec7e5a24c80c(cell1) {{(pid=103932) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:13:59.558644 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.context [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12429ae4-bffe-42b6-ae28-ec7e5a24c80c(cell1) {{(pid=103931) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:13:59.562240 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.562352 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_concurrency.lockutils [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.562868 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.562962 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_concurrency.lockutils [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.564440 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.564656 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_concurrency.lockutils [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.565168 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.565765 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_concurrency.lockutils [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:13:59.565856 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.566218 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_concurrency.lockutils [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:13:59.567861 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.568245 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_concurrency.lockutils [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:13:59.569890 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO dbcounter [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Registered counter for database nova_cell0 Aug 10 11:13:59.570292 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO dbcounter [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Registered counter for database nova_cell0 Aug 10 11:13:59.575279 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO dbcounter [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Registered counter for database nova_cell1 Aug 10 11:13:59.575732 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO dbcounter [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Registered counter for database nova_cell1 Aug 10 11:13:59.583022 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_db.sqlalchemy.engines [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:13:59.585311 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_db.sqlalchemy.engines [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:13:59.587888 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writer thread running {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:13:59.588312 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_db.sqlalchemy.engines [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:13:59.588570 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_db.sqlalchemy.engines [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:13:59.597272 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writer thread running {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:13:59.597604 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writer thread running {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:13:59.728562 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writer thread running {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:13:59.737670 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO dbcounter [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Registered counter for database nova_cell0 Aug 10 11:13:59.744701 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_db.sqlalchemy.engines [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:13:59.744877 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO dbcounter [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Registered counter for database nova_cell0 Aug 10 11:13:59.749087 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writer thread running {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:13:59.754038 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG oslo_db.sqlalchemy.engines [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:13:59.758233 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writer thread running {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:14:00.175617 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: WARNING keystonemiddleware.auth_token [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:14:00.182853 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: WARNING keystonemiddleware.auth_token [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:14:00.192485 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: WARNING keystonemiddleware.auth_token [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:14:00.199599 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: WARNING keystonemiddleware.auth_token [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:14:00.539921 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: WARNING keystonemiddleware.auth_token [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:14:00.545789 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: WARNING keystonemiddleware.auth_token [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:14:00.552148 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ad9a869c0 pid: 103932 (default app) Aug 10 11:14:00.554233 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:14:00.555411 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Aug 10 11:14:00.555529 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: WARNING keystonemiddleware.auth_token [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:14:00.555812 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Wed Aug 10 11:14:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:14:00.561546 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: WARNING keystonemiddleware.auth_token [None req-32f3c100-3c13-4d2d-bd05-9168a6632950 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:14:00.567754 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ad9a869c0 pid: 103931 (default app) Aug 10 11:15:19.665556 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:19.666572 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 10 11:15:19.667824 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:19.686649 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writing DB stats nova_api:SELECT=3 {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:19.689679 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writing DB stats nova_cell0:SELECT=3 {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:19.690724 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writing DB stats nova_cell1:SELECT=3 {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:19.692427 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:20.556896 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-085ea776-a8eb-4691-a7d1-54f310c6ae08 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:20.591478 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-085ea776-a8eb-4691-a7d1-54f310c6ae08 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916336 Aug 10 11:15:20.605532 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1292 bytes} [Wed Aug 10 11:15:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:22.793110 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:22.794084 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-43c1b1f6-5feb-4692-b92c-b561e8858059 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 10 11:15:22.795257 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:23.263506 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-a1437e00-292f-4a77-8f44-7c2d12aff166 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "id": "c1", "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:23.284491 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:15:23.284491 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: warnings.warn(msg) Aug 10 11:15:23.389650 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-a1437e00-292f-4a77-8f44-7c2d12aff166 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.588249 Aug 10 11:15:23.390638 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:15:23.405156 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_api:SELECT=3 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:23.408294 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_cell0:SELECT=3 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:23.409338 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_cell1:SELECT=3 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:23.410242 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:23.623858 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-9017d2d0-ce6c-4028-b49b-8dce20fc06bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:23.628195 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:15:23.628195 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: warnings.warn(msg) Aug 10 11:15:23.770927 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-9017d2d0-ce6c-4028-b49b-8dce20fc06bd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.371395 Aug 10 11:15:23.772112 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 10 11:15:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:26.012268 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-a1437e00-292f-4a77-8f44-7c2d12aff166 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:26.014846 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-a1437e00-292f-4a77-8f44-7c2d12aff166 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 10 11:15:26.014846 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:26.808070 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-b6db2bd8-2b6b-40f3-b8ef-5391b3ac37c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:26.827189 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:15:26.827189 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: warnings.warn(msg) Aug 10 11:15:26.933050 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-b6db2bd8-2b6b-40f3-b8ef-5391b3ac37c2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.912524 Aug 10 11:15:26.933867 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:15:26.946907 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-4915ebd5-fa42-421d-a06c-6d2c43110228 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:26.950947 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:15:26.950947 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: warnings.warn(msg) Aug 10 11:15:27.050598 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-4915ebd5-fa42-421d-a06c-6d2c43110228 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107790 Aug 10 11:15:27.058354 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 10 11:15:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:29.277699 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-b6db2bd8-2b6b-40f3-b8ef-5391b3ac37c2 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:29.278713 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-b6db2bd8-2b6b-40f3-b8ef-5391b3ac37c2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 10 11:15:29.279115 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:29.682091 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-a5a17909-0e46-4440-ba0b-a46ea34136e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "id": "d2"}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:29.760100 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-a5a17909-0e46-4440-ba0b-a46ea34136e6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474070 Aug 10 11:15:29.760657 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:15:29.773262 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-97a86934-f698-4bfb-b56f-23fd9423f228 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:29.849372 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-97a86934-f698-4bfb-b56f-23fd9423f228 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079682 Aug 10 11:15:29.849948 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 10 11:15:29 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:32.064917 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-a5a17909-0e46-4440-ba0b-a46ea34136e6 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:32.065936 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-a5a17909-0e46-4440-ba0b-a46ea34136e6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 10 11:15:32.066488 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:32.527706 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-642ff975-db8e-4c4b-ae75-a7b6b5c715cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "id": "d3"}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:32.602451 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-642ff975-db8e-4c4b-ae75-a7b6b5c715cd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529978 Aug 10 11:15:32.603162 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:15:32.615350 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-d02471f0-149b-45f8-bccf-1ab51ffdd7ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:32.718082 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-d02471f0-149b-45f8-bccf-1ab51ffdd7ef admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106320 Aug 10 11:15:32.719468 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 10 11:15:32 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:34.930473 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-642ff975-db8e-4c4b-ae75-a7b6b5c715cd admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:34.931513 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-642ff975-db8e-4c4b-ae75-a7b6b5c715cd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 10 11:15:34.932123 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:35.361068 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-4b1dc6c4-32d6-4eba-8489-c271540dad21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:35.458461 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-4b1dc6c4-32d6-4eba-8489-c271540dad21 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519622 Aug 10 11:15:35.459009 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:15:35.472687 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-159e534a-08a6-4393-a9c6-4ec593668fb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:35.558560 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-159e534a-08a6-4393-a9c6-4ec593668fb2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090917 Aug 10 11:15:35.559213 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1336 bytes} [Wed Aug 10 11:15:35 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:37.769518 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-4b1dc6c4-32d6-4eba-8489-c271540dad21 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:37.770585 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-4b1dc6c4-32d6-4eba-8489-c271540dad21 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 10 11:15:37.771034 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:15:38.199744 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-14c2d441-0289-4cd9-a056-3be2651470e3 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:38.226100 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-14c2d441-0289-4cd9-a056-3be2651470e3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448847 Aug 10 11:15:38.226664 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1292 bytes} [Wed Aug 10 11:15:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:15:40.738297 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-4b1dc6c4-32d6-4eba-8489-c271540dad21 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:40.738976 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-4b1dc6c4-32d6-4eba-8489-c271540dad21 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001903 Aug 10 11:15:40.739283 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:15:41.165052 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-f3dc1aa6-a6be-4f60-be15-91586fc87635 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "id": "1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:41.234460 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-f3dc1aa6-a6be-4f60-be15-91586fc87635 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.488792 Aug 10 11:15:41.235036 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:15:41.247064 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-b898c0a8-b915-43d7-8997-529bb512d33e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:41.337611 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-b898c0a8-b915-43d7-8997-529bb512d33e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094011 Aug 10 11:15:41.339116 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 10 11:15:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:43.525974 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-f3dc1aa6-a6be-4f60-be15-91586fc87635 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:43.526982 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-f3dc1aa6-a6be-4f60-be15-91586fc87635 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 10 11:15:43.527683 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:43.916757 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-9b2851ca-0bda-42a4-b2da-aafa0c6b911a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 2048, "swap": 0, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:43.989760 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-9b2851ca-0bda-42a4-b2da-aafa0c6b911a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456110 Aug 10 11:15:43.990319 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:15:44.002912 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-8376db91-f8de-4f44-ac8c-6adfa77d5249 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:44.073784 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-8376db91-f8de-4f44-ac8c-6adfa77d5249 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075248 Aug 10 11:15:44.074364 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 10 11:15:43 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:15:46.289757 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-9b2851ca-0bda-42a4-b2da-aafa0c6b911a admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:46.290783 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-9b2851ca-0bda-42a4-b2da-aafa0c6b911a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 10 11:15:46.291180 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:46.677830 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-a909203c-7123-4e63-a5e1-9408bd54d3f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:46.795401 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-a909203c-7123-4e63-a5e1-9408bd54d3f2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.498065 Aug 10 11:15:46.795961 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:46 2022] POST /compute/v2.1/flavors => generated 406 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:15:46.808649 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c70ff8eb-a6c8-40be-843a-a09afc32286f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:47.004336 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-c70ff8eb-a6c8-40be-843a-a09afc32286f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.199364 Aug 10 11:15:47.004925 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 10 11:15:46 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:49.250852 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-a909203c-7123-4e63-a5e1-9408bd54d3f2 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:49.251883 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-a909203c-7123-4e63-a5e1-9408bd54d3f2 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 10 11:15:49.256152 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:49.757734 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-f7ef9ca5-4821-4461-af5b-33cb041f9390 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:50.175989 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:15:50.181976 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-f7ef9ca5-4821-4461-af5b-33cb041f9390 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.923509 Aug 10 11:15:50.182747 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 11:15:50.195829 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-e3e2a427-759e-4c1d-b066-208c700e1d70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:50.274912 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-e3e2a427-759e-4c1d-b066-208c700e1d70 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083152 Aug 10 11:15:50.292311 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 10 11:15:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:15:52.513263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-f7ef9ca5-4821-4461-af5b-33cb041f9390 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:15:52.515032 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-f7ef9ca5-4821-4461-af5b-33cb041f9390 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002153 Aug 10 11:15:52.515633 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:15:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:15:52.970626 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-5877c22c-9d61-4e48-80d5-e36fa5a9cfd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "disk": 160}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:53.105362 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-5877c22c-9d61-4e48-80d5-e36fa5a9cfd3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.583033 Aug 10 11:15:53.105917 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1283 bytes} [Wed Aug 10 11:15:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:15:53.119007 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-d04c2b9a-a830-49f1-922c-cb5691435758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:15:53.221870 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-d04c2b9a-a830-49f1-922c-cb5691435758 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106723 Aug 10 11:15:53.222731 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1333 bytes} [Wed Aug 10 11:15:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:16:13.810037 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-5877c22c-9d61-4e48-80d5-e36fa5a9cfd3 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:13.811049 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-5877c22c-9d61-4e48-80d5-e36fa5a9cfd3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 10 11:16:13.811448 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:16:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:14.195826 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-5aefa74f-c93a-4f65-ab8b-33131fab6446 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:14.214845 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-5aefa74f-c93a-4f65-ab8b-33131fab6446 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396412 Aug 10 11:16:14.215375 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1292 bytes} [Wed Aug 10 11:16:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:16:15.281059 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-5877c22c-9d61-4e48-80d5-e36fa5a9cfd3 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:15.282147 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-5877c22c-9d61-4e48-80d5-e36fa5a9cfd3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 10 11:16:15.283157 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:15.803754 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c363d2d7-0a88-47a3-8191-662c27ff8d12 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:15.809458 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.wsgi [None req-c363d2d7-0a88-47a3-8191-662c27ff8d12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c363d2d7-0a88-47a3-8191-662c27ff8d12 admin admin] Request method failure captured: Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Accept: application/json Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Accept-Encoding: gzip, deflate Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Connection: keep-alive Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Content-Length: 0 Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Host: 10.222.0.13 Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Openstack-Api-Version: compute 2.90 Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Openstack-System-Scope: None Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: User-Agent: python-novaclient Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Auth-Token: gAAAAABi85N_RC7FznLFhApRqhLaamWrpOKwJ-JzdUXG9nglzYmSSv3pk6H0cd7JtxnHz3IBc8tYKwLoR3wcrGO6OJcbZPfkd27RwqjrQPkTMeIWAd47VSatq6dgz1UV_Oirh92HuQIfNkbBmbnUdDZG9wBf4a0Lg_ZZ9Vn3MjC0EsaTMuyTtUI Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Domain-Id: None Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Domain-Name: None Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Identity-Status: Confirmed Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Is-Admin-Project: True Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Domain-Id: default Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Domain-Name: Default Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Name: admin Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Role: admin,member,reader Aug 10 11:16:15.812685 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Roles: admin,member,reader Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant: admin Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant-Name: admin Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User: admin Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Domain-Id: default Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Domain-Name: Default Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Id: 0b3cf49f311d4c78b75ab2d7b48164db Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Name: admin Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: method: > Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: exception: Flavor 42 could not be found. Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: action_args: {'id': '42'} Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:16:15.814996 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:15.816237 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.817866 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c363d2d7-0a88-47a3-8191-662c27ff8d12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:16:15.819134 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-c363d2d7-0a88-47a3-8191-662c27ff8d12 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394336 Aug 10 11:16:15.819134 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Wed Aug 10 11:16:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:15.825282 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-7b270c03-1a1a-4914-86c4-9f6884d4ea7f admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:15.830117 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:16:15.848618 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-7b270c03-1a1a-4914-86c4-9f6884d4ea7f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026931 Aug 10 11:16:15.849173 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 10 11:16:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:16:15.859074 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-11baf916-a367-45c8-ab0e-806cb5d5cbf8 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:15.883720 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-11baf916-a367-45c8-ab0e-806cb5d5cbf8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028152 Aug 10 11:16:15.884279 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 10 11:16:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:16:15.893871 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-b210535a-6b8a-4c25-acbb-783180e95144 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:15.899436 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.wsgi [None req-b210535a-6b8a-4c25-acbb-783180e95144 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-b210535a-6b8a-4c25-acbb-783180e95144 admin admin] Request method failure captured: Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Accept: application/json Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Accept-Encoding: gzip, deflate Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Connection: keep-alive Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Content-Length: 0 Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Host: 10.222.0.13 Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Openstack-Api-Version: compute 2.90 Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Openstack-System-Scope: None Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: User-Agent: python-novaclient Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Auth-Token: gAAAAABi85N_RC7FznLFhApRqhLaamWrpOKwJ-JzdUXG9nglzYmSSv3pk6H0cd7JtxnHz3IBc8tYKwLoR3wcrGO6OJcbZPfkd27RwqjrQPkTMeIWAd47VSatq6dgz1UV_Oirh92HuQIfNkbBmbnUdDZG9wBf4a0Lg_ZZ9Vn3MjC0EsaTMuyTtUI Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Domain-Id: None Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Domain-Name: None Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Identity-Status: Confirmed Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Is-Admin-Project: True Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Domain-Id: default Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Domain-Name: Default Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Name: admin Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Role: admin,member,reader Aug 10 11:16:15.902682 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Roles: admin,member,reader Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant: admin Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant-Name: admin Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User: admin Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Domain-Id: default Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Domain-Name: Default Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Id: 0b3cf49f311d4c78b75ab2d7b48164db Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Name: admin Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: method: > Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: exception: Flavor 42 could not be found. Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: action_args: {'id': '42'} Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:16:15.904316 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:15.905293 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:15.906661 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-b210535a-6b8a-4c25-acbb-783180e95144 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:16:15.907973 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-b210535a-6b8a-4c25-acbb-783180e95144 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013822 Aug 10 11:16:15.907973 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Wed Aug 10 11:16:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:16.861017 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-11baf916-a367-45c8-ab0e-806cb5d5cbf8 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:16.862048 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-11baf916-a367-45c8-ab0e-806cb5d5cbf8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 10 11:16:16.862444 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:16:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:17.386202 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-16de9214-1f51-4391-b755-494bec278771 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:17.392115 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.wsgi [None req-16de9214-1f51-4391-b755-494bec278771 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-16de9214-1f51-4391-b755-494bec278771 admin admin] Request method failure captured: Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Accept: application/json Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Accept-Encoding: gzip, deflate Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Connection: keep-alive Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Content-Length: 0 Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Host: 10.222.0.13 Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Openstack-Api-Version: compute 2.90 Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Openstack-System-Scope: None Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: User-Agent: python-novaclient Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Auth-Token: gAAAAABi85OANQyW_jfqzzRSE5_dto3RrISgPJuNfR8fSMT4F2XOv4zT17LKbcVHFGXUycYGY-hYONqpABABUMt0Bo638_z1pln9BGA5u8TaOGA2RFmQR2sB22ie7tV0hkLXKQ21hVIJEPqg3_lgsYvuKfjFoqSv0D213QVAPAjDICw1svHyj0U Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Domain-Id: None Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Domain-Name: None Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Identity-Status: Confirmed Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Is-Admin-Project: True Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Domain-Id: default Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Domain-Name: Default Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Name: admin Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Role: admin,member,reader Aug 10 11:16:17.393616 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Roles: admin,member,reader Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant: admin Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant-Name: admin Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User: admin Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Domain-Id: default Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Domain-Name: Default Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Id: 0b3cf49f311d4c78b75ab2d7b48164db Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Name: admin Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: method: > Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: exception: Flavor 84 could not be found. Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: action_args: {'id': '84'} Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:16:17.395086 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:17.396042 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.397474 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-16de9214-1f51-4391-b755-494bec278771 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:16:17.398687 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-16de9214-1f51-4391-b755-494bec278771 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394847 Aug 10 11:16:17.398687 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Wed Aug 10 11:16:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:17.404806 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-11634dbd-6ec7-40cd-a7f2-fbf88d4eaf2f admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:17.420719 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-11634dbd-6ec7-40cd-a7f2-fbf88d4eaf2f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019532 Aug 10 11:16:17.421243 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 10 11:16:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:16:17.430748 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-8b010a2d-805d-44b1-8346-c4b1ede930d8 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:17.446341 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-8b010a2d-805d-44b1-8346-c4b1ede930d8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019042 Aug 10 11:16:17.446860 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 10 11:16:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:16:17.456499 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-6b7b613e-029b-44be-bd10-68f92bd26cd3 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:17.461892 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.wsgi [None req-6b7b613e-029b-44be-bd10-68f92bd26cd3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-6b7b613e-029b-44be-bd10-68f92bd26cd3 admin admin] Request method failure captured: Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Accept: application/json Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Accept-Encoding: gzip, deflate Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Connection: keep-alive Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Content-Length: 0 Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Host: 10.222.0.13 Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Openstack-Api-Version: compute 2.90 Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Openstack-System-Scope: None Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: User-Agent: python-novaclient Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Auth-Token: gAAAAABi85OANQyW_jfqzzRSE5_dto3RrISgPJuNfR8fSMT4F2XOv4zT17LKbcVHFGXUycYGY-hYONqpABABUMt0Bo638_z1pln9BGA5u8TaOGA2RFmQR2sB22ie7tV0hkLXKQ21hVIJEPqg3_lgsYvuKfjFoqSv0D213QVAPAjDICw1svHyj0U Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Domain-Id: None Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Domain-Name: None Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Identity-Status: Confirmed Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Is-Admin-Project: True Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Domain-Id: default Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Domain-Name: Default Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Name: admin Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Role: admin,member,reader Aug 10 11:16:17.463419 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Roles: admin,member,reader Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant: admin Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant-Name: admin Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User: admin Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Domain-Id: default Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Domain-Name: Default Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Id: 0b3cf49f311d4c78b75ab2d7b48164db Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Name: admin Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: method: > Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: exception: Flavor 84 could not be found. Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: action_args: {'id': '84'} Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:16:17.464927 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:17.465910 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:17.467263 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-6b7b613e-029b-44be-bd10-68f92bd26cd3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:16:17.468503 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-6b7b613e-029b-44be-bd10-68f92bd26cd3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012444 Aug 10 11:16:17.468503 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Wed Aug 10 11:16:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 11:16:18.434648 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-8b010a2d-805d-44b1-8346-c4b1ede930d8 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:18.435716 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-8b010a2d-805d-44b1-8346-c4b1ede930d8 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 10 11:16:18.436143 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:18.963295 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-ba90dbc6-e606-4c37-bada-e26b73322cf1 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:18.969049 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.wsgi [None req-ba90dbc6-e606-4c37-bada-e26b73322cf1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-ba90dbc6-e606-4c37-bada-e26b73322cf1 admin admin] Request method failure captured: Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Accept: application/json Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Accept-Encoding: gzip, deflate Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Connection: keep-alive Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Content-Length: 0 Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Host: 10.222.0.13 Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Openstack-Api-Version: compute 2.90 Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Openstack-System-Scope: None Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: User-Agent: python-novaclient Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Auth-Token: gAAAAABi85OCa3-LaoLmCXqSaIiSQJU5e4nMy1-TGpunULkZ80X-k7mo-Zj_EFBJQPVtnbgxOJRnkvL6ugZNDVY1cSV13FeISldQPS0I_3_fS_I0erMAvYa_XZQRK53JM5rWgL3kPaKyvnXuD5q7rENytcAXe4CWNF57UkYqvJgPM4CsbLEOrgM Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Domain-Id: None Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Domain-Name: None Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Identity-Status: Confirmed Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Is-Admin-Project: True Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Domain-Id: default Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Domain-Name: Default Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Project-Name: admin Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Role: admin,member,reader Aug 10 11:16:18.971211 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Roles: admin,member,reader Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant: admin Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-Tenant-Name: admin Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User: admin Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Domain-Id: default Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Domain-Name: Default Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Id: 0b3cf49f311d4c78b75ab2d7b48164db Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: X-User-Name: admin Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: method: > Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: exception: Flavor 451 could not be found. Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: action_args: {'id': '451'} Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:16:18.972740 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:18.973713 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: ERROR nova.api.openstack.wsgi Aug 10 11:16:18.975055 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-ba90dbc6-e606-4c37-bada-e26b73322cf1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:16:18.976288 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-ba90dbc6-e606-4c37-bada-e26b73322cf1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390231 Aug 10 11:16:18.976288 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 10 11:16:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:18.982366 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-3c8b7ec6-fe71-451b-9f0e-e225070657a6 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:18.997498 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-3c8b7ec6-fe71-451b-9f0e-e225070657a6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018664 Aug 10 11:16:18.998019 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 10 11:16:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:16:19.008107 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:19.022642 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018014 Aug 10 11:16:19.023154 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Wed Aug 10 11:16:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:16:19.032261 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-f4995593-e1ea-4610-b165-36c06c5e673e admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:19.037502 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.wsgi [None req-f4995593-e1ea-4610-b165-36c06c5e673e admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-f4995593-e1ea-4610-b165-36c06c5e673e admin admin] Request method failure captured: Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Accept: application/json Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Accept-Encoding: gzip, deflate Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Connection: keep-alive Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Content-Length: 0 Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Host: 10.222.0.13 Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Openstack-Api-Version: compute 2.90 Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Openstack-System-Scope: None Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: User-Agent: python-novaclient Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Auth-Token: gAAAAABi85OCa3-LaoLmCXqSaIiSQJU5e4nMy1-TGpunULkZ80X-k7mo-Zj_EFBJQPVtnbgxOJRnkvL6ugZNDVY1cSV13FeISldQPS0I_3_fS_I0erMAvYa_XZQRK53JM5rWgL3kPaKyvnXuD5q7rENytcAXe4CWNF57UkYqvJgPM4CsbLEOrgM Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Domain-Id: None Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Domain-Name: None Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Identity-Status: Confirmed Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Is-Admin-Project: True Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Domain-Id: default Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Domain-Name: Default Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Project-Name: admin Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Role: admin,member,reader Aug 10 11:16:19.038989 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Roles: admin,member,reader Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_1f5409bf396e4a7cbe05519266660a63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant: admin Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant-Id: 1f5409bf396e4a7cbe05519266660a63 Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-Tenant-Name: admin Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User: admin Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Domain-Id: default Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Domain-Name: Default Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Id: 0b3cf49f311d4c78b75ab2d7b48164db Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: X-User-Name: admin Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: method: > Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: exception: Flavor 451 could not be found. Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: action_args: {'id': '451'} Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:16:19.040457 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:19.041236 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: ERROR nova.api.openstack.wsgi Aug 10 11:16:19.042292 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-f4995593-e1ea-4610-b165-36c06c5e673e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:16:19.043282 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-f4995593-e1ea-4610-b165-36c06c5e673e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011584 Aug 10 11:16:19.043282 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 10 11:16:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 11:16:20.009594 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:20.010684 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 10 11:16:20.011048 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:16:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:20.538532 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-2956201f-fa91-4867-89d9-19328f33c21d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:20.605822 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-2956201f-fa91-4867-89d9-19328f33c21d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.448859 Aug 10 11:16:20.610853 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Wed Aug 10 11:16:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:16:21.584946 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:21.590348 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 10 11:16:21.590348 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:22.109675 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-405531fa-12b5-421b-92ee-103aad87444a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:22.217047 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-405531fa-12b5-421b-92ee-103aad87444a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.491908 Aug 10 11:16:22.217592 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Wed Aug 10 11:16:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:16:23.212925 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:23.214317 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001755 Aug 10 11:16:23.214704 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:16:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:23.733620 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-fb909e00-5d90-4150-a981-1fa92aaf3b81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:23.811187 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-fb909e00-5d90-4150-a981-1fa92aaf3b81 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.458709 Aug 10 11:16:23.811730 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Wed Aug 10 11:16:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:16:24.768872 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:24.769920 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Aug 10 11:16:24.770312 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:16:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:25.294692 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-caad7c89-e7de-417c-b279-b1001f9b52ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:16:25.417552 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-caad7c89-e7de-417c-b279-b1001f9b52ec admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.509311 Aug 10 11:16:25.418137 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Wed Aug 10 11:16:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:16:26.403837 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:26.404890 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 10 11:16:26.405275 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:16:26.925180 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-9434c9aa-1d57-4a73-96f0-edb17ec0e093 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:16:26.946103 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-9434c9aa-1d57-4a73-96f0-edb17ec0e093 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400184 Aug 10 11:16:26.946623 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Wed Aug 10 11:16:26 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:18.468594 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:18.469638 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-341144c9-b33b-4a1d-a2af-3a2e7e55357f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 10 11:17:18.470032 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 931 bytes} [Wed Aug 10 11:17:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:17:18.480499 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:18.859348 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-fcb3b795-5c97-4784-9717-37e67147e065 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:18.880981 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-fcb3b795-5c97-4784-9717-37e67147e065 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404876 Aug 10 11:17:18.881464 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1292 bytes} [Wed Aug 10 11:17:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:17:18.905588 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-9b58c5cc-c2a7-495e-8a2c-79605eee9be1 admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:18.909046 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG dbcounter [-] [103931] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:17:18.914504 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-9b58c5cc-c2a7-495e-8a2c-79605eee9be1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012527 Aug 10 11:17:18.915060 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1283 bytes} [Wed Aug 10 11:17:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:17:18.928449 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-38eccbb0-8c58-4c9d-a640-643894bc5d3f admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:18.936137 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-38eccbb0-8c58-4c9d-a640-643894bc5d3f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011306 Aug 10 11:17:18.936650 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1286 bytes} [Wed Aug 10 11:17:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:18.948600 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:18.956659 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011575 Aug 10 11:17:18.957174 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1286 bytes} [Wed Aug 10 11:17:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:17:18.969383 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-8a1ec311-9222-401e-9fd6-bdfa6a359997 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:17:18.977776 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-8a1ec311-9222-401e-9fd6-bdfa6a359997 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012004 Aug 10 11:17:18.978285 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1283 bytes} [Wed Aug 10 11:17:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:20:29.624254 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:29.625281 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 10 11:20:29.625709 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:29.768820 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_api:SELECT=6 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:29.924265 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-beee7b9c-689b-45fd-8d74-2345b1eb00bc admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:29.926600 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:20:29.926600 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: warnings.warn(msg) Aug 10 11:20:29.927710 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-beee7b9c-689b-45fd-8d74-2345b1eb00bc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:29.928216 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-beee7b9c-689b-45fd-8d74-2345b1eb00bc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:29.928643 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-beee7b9c-689b-45fd-8d74-2345b1eb00bc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:29.929378 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-beee7b9c-689b-45fd-8d74-2345b1eb00bc admin admin] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:29.930496 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-beee7b9c-689b-45fd-8d74-2345b1eb00bc admin admin] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:29.931647 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-beee7b9c-689b-45fd-8d74-2345b1eb00bc admin admin] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:29.963985 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-beee7b9c-689b-45fd-8d74-2345b1eb00bc admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196809 Aug 10 11:20:29.964551 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 10 11:20:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:20:30.804489 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:30.806005 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 10 11:20:30.806400 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:20:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:30.996532 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-9908384c-a3b6-4196-b6fb-882976533279 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:30.998883 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:20:30.998883 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: warnings.warn(msg) Aug 10 11:20:30.999977 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-9908384c-a3b6-4196-b6fb-882976533279 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:31.000468 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-9908384c-a3b6-4196-b6fb-882976533279 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:31.000893 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-9908384c-a3b6-4196-b6fb-882976533279 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:31.001592 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-9908384c-a3b6-4196-b6fb-882976533279 admin admin] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:31.002031 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-9908384c-a3b6-4196-b6fb-882976533279 admin admin] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:31.002440 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-9908384c-a3b6-4196-b6fb-882976533279 admin admin] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:31.021971 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-9908384c-a3b6-4196-b6fb-882976533279 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077490 Aug 10 11:20:31.022500 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 10 11:20:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:20:42.277137 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:42.278187 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 10 11:20:42.278583 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:42.422002 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_cell0:SELECT=4 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:42.422728 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_cell1:SELECT=4 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:42.423348 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG dbcounter [-] [103932] Writing DB stats nova_api:SELECT=8 {{(pid=103932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:20:42.470698 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-a405add3-9d03-48c8-a385-5b019dd0748b admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:42.473119 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:20:42.473119 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: warnings.warn(msg) Aug 10 11:20:42.474217 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-a405add3-9d03-48c8-a385-5b019dd0748b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:42.474690 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-a405add3-9d03-48c8-a385-5b019dd0748b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:42.475119 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-a405add3-9d03-48c8-a385-5b019dd0748b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:42.475835 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-a405add3-9d03-48c8-a385-5b019dd0748b admin admin] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:42.476309 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-a405add3-9d03-48c8-a385-5b019dd0748b admin admin] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:42.476730 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-a405add3-9d03-48c8-a385-5b019dd0748b admin admin] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:42.502675 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-a405add3-9d03-48c8-a385-5b019dd0748b admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084981 Aug 10 11:20:42.503167 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 10 11:20:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:20:43.333847 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: DEBUG nova.api.openstack.wsgi [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] Calling method '>' {{(pid=103931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:43.334854 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: INFO nova.api.openstack.requestlog [None req-c9cda697-e32f-49fb-ad4d-81dc4ccf1afb admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Aug 10 11:20:43.335246 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: [pid: 103931|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Wed Aug 10 11:20:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:20:43.526683 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG nova.api.openstack.wsgi [None req-97af3429-a24a-40ba-8ece-68828ca59aa6 admin admin] Calling method '>' {{(pid=103932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:20:43.529076 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 11:20:43.529076 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: warnings.warn(msg) Aug 10 11:20:43.530194 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-97af3429-a24a-40ba-8ece-68828ca59aa6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:43.530695 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-97af3429-a24a-40ba-8ece-68828ca59aa6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:43.531122 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-97af3429-a24a-40ba-8ece-68828ca59aa6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:43.531836 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-97af3429-a24a-40ba-8ece-68828ca59aa6 admin admin] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:20:43.532318 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-97af3429-a24a-40ba-8ece-68828ca59aa6 admin admin] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:20:43.532735 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: DEBUG oslo_concurrency.lockutils [None req-97af3429-a24a-40ba-8ece-68828ca59aa6 admin admin] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:20:43.553871 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: INFO nova.api.openstack.requestlog [None req-97af3429-a24a-40ba-8ece-68828ca59aa6 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078920 Aug 10 11:20:43.554354 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: [pid: 103932|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Wed Aug 10 11:20:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:21:42.004500 dv-cinder-850618-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 11:21:42.005358 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: Wed Aug 10 11:21:42 2022 - graceful shutdown triggered... Aug 10 11:21:42.005837 dv-cinder-850618-2-iscsi devstack@n-api.service[103931]: Gracefully killing worker 1 (pid: 103931)... Aug 10 11:21:42.006237 dv-cinder-850618-2-iscsi devstack@n-api.service[103932]: Gracefully killing worker 2 (pid: 103932)... Aug 10 11:21:43.006505 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: worker 1 buried after 1 seconds Aug 10 11:21:43.006991 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: worker 2 buried after 1 seconds Aug 10 11:21:43.006991 dv-cinder-850618-2-iscsi devstack@n-api.service[103930]: goodbye to uWSGI. Aug 10 11:21:43.008160 dv-cinder-850618-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 10 11:21:43.008714 dv-cinder-850618-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 11:21:43.011482 dv-cinder-850618-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 11:21:43.023777 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 11:21:43 2022] *** Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: nodename: dv-cinder-850618-2-iscsi Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: machine: x86_64 Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: clock source: unix Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: pcre jit disabled Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: detected number of CPU cores: 4 Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: current working directory: / Aug 10 11:21:43.025705 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: detected binary path: /usr/bin/uwsgi-core Aug 10 11:21:43.026403 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: your processes number limit is 47680 Aug 10 11:21:43.026403 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: your memory page size is 4096 bytes Aug 10 11:21:43.026403 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: detected max file descriptor number: 2048 Aug 10 11:21:43.026403 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: lock engine: pthread robust mutexes Aug 10 11:21:43.026403 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: thunder lock: enabled Aug 10 11:21:43.026403 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 11:21:43.026403 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 11:21:43.066066 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: Python main interpreter initialized at 0x55a3e584b9c0 Aug 10 11:21:43.066066 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: python threads support enabled Aug 10 11:21:43.066066 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: your server socket listen backlog is limited to 100 connections Aug 10 11:21:43.066066 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: your mercy for graceful operations on workers is 90 seconds Aug 10 11:21:43.066500 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 11:21:43.066500 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: *** Operational MODE: preforking *** Aug 10 11:21:43.066776 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: *** uWSGI is running in multiple interpreter mode *** Aug 10 11:21:43.066776 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: spawned uWSGI master process (pid: 118412) Aug 10 11:21:43.066987 dv-cinder-850618-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 10 11:21:43.067671 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: spawned uWSGI worker 1 (pid: 118425, cores: 1) Aug 10 11:21:43.067941 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: spawned uWSGI worker 2 (pid: 118426, cores: 1) Aug 10 11:21:43.068180 dv-cinder-850618-2-iscsi devstack@n-api.service[118412]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 11:21:43.728959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:21:43.732604 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 11:21:44.885078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:21:44.885078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: from cryptography.utils import int_from_bytes Aug 10 11:21:44.885748 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:21:44.885748 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: from cryptography.utils import int_from_bytes Aug 10 11:21:44.923195 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:21:44.923195 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: from cryptography.utils import int_from_bytes Aug 10 11:21:44.923753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 11:21:44.923753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: from cryptography.utils import int_from_bytes Aug 10 11:21:47.188156 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:21:47.188736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:21:47.188942 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:21:47.189305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:21:47.189565 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:21:47.189963 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.190290 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.190616 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.190938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.191270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.191583 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.191909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.192268 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.192609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.192891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.193196 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.193527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-2-iscsi {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.193849 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.194162 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.194479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.194801 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.195113 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.195441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.195751 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.196282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.196733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.197307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.197768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.197972 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.198294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.198610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.198935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.199248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.199577 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.199900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.200326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-2-iscsi {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.200649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.200969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.201291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.201711 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.202023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.202340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.203376 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.203706 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.204041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.204379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.204704 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.205079 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.205447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.205765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.206066 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.210658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.211059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.211059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.211059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.211566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.211729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.211975 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.212311 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.212650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.212965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.213294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.213608 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.213933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.214351 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.214609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.214921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.215266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.215588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.215901 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.216246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.216570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.216881 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.217191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.217501 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.217823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.218179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.218486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.218747 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.219049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.219358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.219679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.219990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.220323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.220634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.220939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.221248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.221557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.221868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.222181 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.222496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.222808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.223115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.223421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.223589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 11:21:47.224085 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.224244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 11:21:47.224432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.224432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.224722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 11:21:47.224877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.225027 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 11:21:47.225175 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.225325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 11:21:47.225473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.225630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.225790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.225937 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.226087 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.226241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.226383 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.226531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.226681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.226830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.226984 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.227132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.227279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.227420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.227559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.227709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.227877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.228135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.228291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.228476 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.228634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.228782 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.228948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.229099 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850618-2-iscsi {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.229248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.229390 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.229531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.229681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.229919 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.230077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.230219 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.230401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.230547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.230703 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.230845 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.230985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.231131 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.231279 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.231461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.231461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.231747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.231924 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.232102 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.232411 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.232655 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.232823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.233036 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.233192 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.233345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.233589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.233814 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.234028 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.234199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.234383 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.234527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.234669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.234827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.234969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.235109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.235258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.235400 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.235548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.235548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.235826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850618-2-iscsi {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.235987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.236159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.236159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.236439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.236625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.236770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.236770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.237054 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.237209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.237351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.237490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.237641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.237781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.237932 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.238085 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.238237 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.238378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.238524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.238665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.238818 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.238967 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.239109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.239257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.239404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.239552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.239718 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.239883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.240124 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.240272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.240413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.240562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.240713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.240862 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.241011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.241160 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.241307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.241446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.241640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.241640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.241932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.242073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.242213 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.242386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.242598 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.242822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.242976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.243212 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.243371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.243523 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.243764 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.243929 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.244134 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.244287 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.244438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.244618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.244772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.244912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.245067 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.245208 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.245358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.245498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.245637 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.245801 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.245958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.246107 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.246262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.246411 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.246559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.246709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.246851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.247000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.247155 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.247306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.247448 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.247595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.247752 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.247906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.248074 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.248221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.248368 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.248509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.248656 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.248810 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.248951 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.249091 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.249779 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.249945 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.250104 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.250413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.250576 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.250718 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.250864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.251005 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.251152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.251306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.251447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.251596 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.251791 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.251943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.252118 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.252280 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.252421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.252587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.252840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.253060 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.253233 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.253456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.253609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.253777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.253777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.254152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.254309 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.254451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.254603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.254744 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.254885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.255032 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.255183 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.255323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.255464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.255605 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.255754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.255902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.256072 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.256232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.256377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.256527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.256667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.256817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.256965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.257104 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.257249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.257399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.257548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.257688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.257838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.257979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.258119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.258268 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.258420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.258567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.258716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.258863 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.259005 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.259146 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.259294 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.259442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.259596 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.259738 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.259884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.260352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.260582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.260731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.260923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.260923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.261213 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.261368 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.261517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.261658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.261847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.261992 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.262140 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.262291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.262441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.262600 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.262748 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.262971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.263206 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.263362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.263597 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.263755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.263905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.264155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.264317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.264461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.264603 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.264751 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.265037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.265911 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.266073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.266223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.266370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.266511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.266652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.266800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.266950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.267534 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.267688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.267837 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.267978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.268179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.268332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.268480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.268622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.268769 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.268916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.269071 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.269352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.269508 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.269651 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.269791 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.269939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.270198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.270360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.270504 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.270746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.270896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.270896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 11:21:47.271187 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.271187 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.271466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.271607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.271755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.271755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.272243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.272428 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.272695 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.272852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.273017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.273258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.273481 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.273723 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.273878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.274028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.274193 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.274439 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.274587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.274729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.274888 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.275037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.275177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.275327 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.275469 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.275619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.276256 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.276404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.276555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.276707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.276849 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.277033 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.277186 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.277341 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.277491 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.277641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.278002 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.278164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.278308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.278461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.278614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.278767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.278955 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.279113 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.279257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.279409 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.279631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.279776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.279918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.280177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.280322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.281177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.281339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.281481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.281621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.281763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.281911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.282114 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.282280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.282430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.282579 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.282721 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.282875 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.283028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.283281 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.283456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.284023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.284187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.284331 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.284587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.284737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.284890 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.285031 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.285173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.285371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.285526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.285682 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.285826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.285826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.286107 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.286259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.286401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.286552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.286710 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.286872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.287021 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.287172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.287321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.287508 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.287649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.287789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.287936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.288112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.288265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.288414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.288830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.288945 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.289054 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.289177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.289335 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.289510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.289627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.289743 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.289863 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.289981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.290098 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.290209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.290327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.290444 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.290573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.290684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.290792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.290908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.291024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.291133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.291273 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.291469 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.291609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.291770 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.291884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.292073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.295380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.295568 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.295718 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.295874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.296046 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.296960 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.297128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.297274 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.297425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.297620 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.297776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.297936 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.298081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.298222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.298374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.298515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.298657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.298814 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.299010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.299160 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.299309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.299462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.299612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.299763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.299906 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.300077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.300225 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.300388 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.300544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.300706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.300955 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.301194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.301355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.301608 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.301807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.301953 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.302102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.302251 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.302393 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.302546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.302706 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.302849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.303030 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.303185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.303328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.303562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.303719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.303869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.304257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.304408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.304548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.304703 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.304867 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.305131 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.305288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.305438 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.305600 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.305802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.305802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.306092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.306278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.306464 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.306747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.306747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.307078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.307244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.307400 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.307559 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.307715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.307872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.308041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.308207 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.308358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.308514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.308677 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.308827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.308981 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.309143 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.309292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.309446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.309603 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.309760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.309921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.310070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.310226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.310384 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.310540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.310701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.310859 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.311167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.311344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.311494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.311782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.312045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.312218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.312506 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.312667 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.312849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.313209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.313209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.313497 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.313853 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.314053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.314369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.314536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.314694 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.314850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.315012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.315308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.315473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.315631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.315787 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.315951 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.316124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.316310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.316462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.316631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.316795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.316954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.317103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.317260 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.317409 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.317564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.317721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.317884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.318040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.318190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.318376 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.318530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.318698 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.318856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.319012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.319177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.319329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.319485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.319642 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.319800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.319956 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.320139 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.320296 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.320486 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.320663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.320814 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.321047 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.321303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.321420 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.321616 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.321761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.321987 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.322355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.322500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.322618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.322618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.322847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.322966 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.323084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.323194 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.323339 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.323468 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.323589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.323715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.323903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.329501 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.329687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.330049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.330213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.330364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.330533 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.330692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.330842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.331000 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.331151 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.331319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.331622 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.331788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.331965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.332286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.332470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.332749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.332905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.333114 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.333279 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.333449 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.333630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.333802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.334056 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.334213 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.334378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.334702 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.334865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.335014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.335162 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.335321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.335570 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.335842 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.336036 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.336204 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.336355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.336617 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.336881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.337046 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.337203 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.337355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.337505 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.337667 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.337836 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.337986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.338170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.338322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.338478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.338637 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.338787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.338935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.339084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.339231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.339379 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.339575 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.339740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.339937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.340111 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.340271 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.340428 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.340586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.340901 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.341063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.341215 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.341365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.341524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.341785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.341951 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.342101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.342287 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.342513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.342677 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.342829 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.343536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.343697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.343697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.344358 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.344358 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.344851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.345010 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.345168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.345168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.345465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.345628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.345788 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.346037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.346201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.346351 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.346511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.346757 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.347000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.347592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.347759 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.347918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.348214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.348509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.348678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.348829 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.349017 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.349181 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.349344 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.349494 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.349650 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.349806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.349957 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.350114 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.350278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.350448 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.350597 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.350753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.350753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.351058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.351211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.351366 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.351515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.351671 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.351923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.351923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.352278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.352428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.352682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.352846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353004 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353116 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353290 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.353970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.354047 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.354117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.354314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.354426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.354514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.354587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.354657 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.354726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355007 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355082 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355247 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355458 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355686 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355758 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355829 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355898 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.355974 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356326 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356623 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356708 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.356887 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357473 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357553 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357656 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357656 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357882 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.357959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358036 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358549 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.358775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.359372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.359446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.359635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.359717 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.359804 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.359876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.359956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360486 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360703 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360775 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360858 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.360937 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361366 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361636 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361793 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.361973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.362053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.362133 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.362468 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.362550 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.362627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.362627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.362977 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363054 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363416 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363489 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363693 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.363946 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.364084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.364162 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.364232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.364301 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.364371 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.374602 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.375630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.375761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.375879 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376062 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376463 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376463 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.376696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.377554 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.377674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.377795 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.377906 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378022 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378351 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378512 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378630 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378849 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.378958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.379076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.379189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.379305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.379416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.379525 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.379673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.379867 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.379981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.380132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.380257 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.380375 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.380494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.384282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.384418 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.384647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.384647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.384867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.384986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.385134 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.385265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.385394 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.385705 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.385840 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.385981 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.386152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.386281 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.386416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.386545 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.386674 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.386812 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.386955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.387180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.387322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.387468 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.387742 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.387877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.387877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.388200 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.388314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.388432 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.388555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.388681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.388800 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.388929 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.389387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.389518 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.389629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.389749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.389914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.390037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.390185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.390491 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.390614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.390726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.390842 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.390952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.391070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.391180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.391298 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.391444 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.391563 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.391680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.391790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.391921 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.392065 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.392221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.392337 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.392447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.392593 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.392712 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.392831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.392942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.393058 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.393177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.393317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.393437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.393589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.393725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.393837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.393946 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.394064 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.394391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.394523 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.394660 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.394850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.394976 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.395099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.395218 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.395328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.395470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.395737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.395952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.396180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.396355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.396482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.396600 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.396716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.396842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.396961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.398045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.398180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.398295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.398442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.398569 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.398682 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.398793 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.398902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399021 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399142 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399262 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.399963 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.400130 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.400246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.400391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.400391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.404080 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.404080 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.404554 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.404554 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.404888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.405122 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.405298 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.405460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.406330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.406486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.406636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.406796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.406954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.407103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.407258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.407408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.407557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.407557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.407889 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.408325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.408526 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.408679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.408828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.409063 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.409223 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.409380 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.409530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.409773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.409945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.410118 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.410277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.410461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.410643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.410801 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.410965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.411116 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.411264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.411420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.411577 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.411734 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.411918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.412093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.412261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.412422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.413321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.413321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.413631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.413782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.413938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.414102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.414277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.414728 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.414904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.415070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.415323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.415490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.415659 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.415819 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.415968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.416366 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.416564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.416720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.416876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.417026 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.417174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.417334 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.417497 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.417647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.417802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.417958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.418390 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.418584 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.418777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.418939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.419096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.419251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.419403 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.419561 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.419722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.419871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.420045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.420201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.420352 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.420658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.420818 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.420981 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.421266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.421950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.422221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.422387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.422559 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.422717 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.422717 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.423010 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.423212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.423370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.423521 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.423669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.423825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.423974 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.424173 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.424332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.424494 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.424714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425216 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425429 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425516 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.425954 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.426039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.426121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.426204 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.426537 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.426672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.426802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.426890 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.426968 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427136 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427414 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427577 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427791 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.427928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.428979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429161 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429492 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429680 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429770 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.429958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430392 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.430958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431315 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431399 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431481 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431743 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431838 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.431838 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432047 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432218 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432311 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432409 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432494 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432583 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432685 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.432971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433233 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433611 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433693 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.433967 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434133 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434394 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434569 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.434994 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.435098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.435425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.435530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.435616 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.435724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.435811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.435903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.435988 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436375 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436583 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436662 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.436920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437003 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437003 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437145 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437230 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437394 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437660 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.437912 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438003 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438086 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438212 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438311 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438495 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.438959 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439131 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439569 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439816 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.439906 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440271 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440369 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440549 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.440923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441192 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441368 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441545 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.441967 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442154 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442414 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442505 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442686 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.442931 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443020 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443103 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443532 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443601 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443746 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443836 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443925 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.443925 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444104 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444376 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444458 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444458 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444458 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444458 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444458 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444784 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.444932 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445003 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445081 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445158 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445235 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445325 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445571 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445791 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.445930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446004 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446539 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446617 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.446851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447009 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447356 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447523 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447612 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447704 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447788 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.447950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448534 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448615 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448696 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448862 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.448932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449445 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449608 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449608 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.449946 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450028 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450217 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450565 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.450971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451245 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451336 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451501 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.451949 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.452060 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.452132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.452202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.452271 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.452883 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.453381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.453491 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.453573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.453646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.453716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.453794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.453880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.453952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454022 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454181 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454758 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454897 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.454965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455047 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455118 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455397 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455728 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455813 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455893 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.455965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456313 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456455 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.456993 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457145 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457216 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457666 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457893 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.457965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458036 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458398 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458398 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.458639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459027 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459108 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459187 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:21:47.459695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.459695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.460865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.461173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.461393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.461715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.462028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.462465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.462783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.463104 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.463431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.463747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.464161 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.464429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.464750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.465076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.465389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.465774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.466069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.466401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.466732 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.467042 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.467362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.467661 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.467979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.469372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.469372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.469586 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.469771 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.470086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.470396 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.470708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.471018 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.471327 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.471640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.471946 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.472278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.472590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.472898 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.473207 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.473513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.473828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.474136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.474447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.474760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.475072 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.475381 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.475726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.476401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.476401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.476708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.477009 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.477333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.477645 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.477970 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.478293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.478619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.478930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.479269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.479585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.479900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.480243 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.480559 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.480888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.481185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.481524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.481856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.482167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.482497 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.482818 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.483146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.483466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.483815 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.484315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.484644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.484963 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.485278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.485595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.485909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.486320 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.486635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.486848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.487171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.487493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.487827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.488186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.488503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.488835 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.489168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.489530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.489850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.490200 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.490539 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.490858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.491189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.491483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 11:21:47.491733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118425) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 11:21:47.616499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO dbcounter [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Registered counter for database nova_api Aug 10 11:21:47.639821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_db.sqlalchemy.engines [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:21:47.645534 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO dbcounter [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Registered counter for database nova_api Aug 10 11:21:47.652087 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writer thread running {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:21:47.673462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_db.sqlalchemy.engines [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:21:47.681888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writer thread running {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:21:47.722340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.context [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12429ae4-bffe-42b6-ae28-ec7e5a24c80c(cell1) {{(pid=118426) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:21:47.726974 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:47.727462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:47.729083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:47.729828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:47.730277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:47.732335 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:47.734427 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO dbcounter [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Registered counter for database nova_cell0 Aug 10 11:21:47.741775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO dbcounter [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Registered counter for database nova_cell1 Aug 10 11:21:47.751674 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.context [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),12429ae4-bffe-42b6-ae28-ec7e5a24c80c(cell1) {{(pid=118425) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 11:21:47.756300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:47.756777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_db.sqlalchemy.engines [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:21:47.757369 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:47.757592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_db.sqlalchemy.engines [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:21:47.760009 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:47.761179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:21:47.762141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:21:47.764766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:21:47.767282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writer thread running {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:21:47.767885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO dbcounter [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Registered counter for database nova_cell0 Aug 10 11:21:47.768623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writer thread running {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:21:47.773410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO dbcounter [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Registered counter for database nova_cell1 Aug 10 11:21:47.782177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_db.sqlalchemy.engines [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:21:47.791260 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_db.sqlalchemy.engines [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:21:47.798557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writer thread running {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:21:47.799077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writer thread running {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:21:47.942531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO dbcounter [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Registered counter for database nova_cell0 Aug 10 11:21:47.950221 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_db.sqlalchemy.engines [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:21:47.955818 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writer thread running {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:21:47.959722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO dbcounter [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Registered counter for database nova_cell0 Aug 10 11:21:47.967943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_db.sqlalchemy.engines [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118425) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 11:21:47.974362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writer thread running {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 11:21:48.275492 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: WARNING keystonemiddleware.auth_token [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:21:48.283263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: WARNING keystonemiddleware.auth_token [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:21:48.292078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: WARNING keystonemiddleware.auth_token [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:21:48.299805 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: WARNING keystonemiddleware.auth_token [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:21:48.629396 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: WARNING keystonemiddleware.auth_token [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:21:48.635391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: WARNING keystonemiddleware.auth_token [None req-c2117a4c-926d-49e3-a6c6-a1b068e5cdd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:21:48.641769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a3e584b9c0 pid: 118426 (default app) Aug 10 11:21:48.643429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: WARNING keystonemiddleware.auth_token [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 11:21:48.649392 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: WARNING keystonemiddleware.auth_token [None req-81c1d22c-cb05-49a0-859b-6ee856617913 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 11:21:48.656170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a3e584b9c0 pid: 118425 (default app) Aug 10 11:22:25.656430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.657398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.658220 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.659087 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.819823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=3 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.820911 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=3 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.822417 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=3 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:25.824448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=3 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:26.563137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-230959c3-77c1-4b69-ad49-9815eb4c62f9 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Action: 'create', calling method: .version_select at 0x7f6f46861dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2105295664", "metadata": {"Type": "work"}}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:26.692741 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fcd425af-dcff-4bc9-abc9-ed3fbaa6d16f tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Action: 'create', calling method: .version_select at 0x7f6f467a8040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2088349962"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:28.702840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-230959c3-77c1-4b69-ad49-9815eb4c62f9 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.054537 Aug 10 11:22:28.704448 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1156 bytes} [Wed Aug 10 11:22:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3058 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 11:22:28.721794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fcc3ffe2-6f75-4158-9482-38c763b23d77 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Calling method '.version_select at 0x7f6f46752c10>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:28.886905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fcc3ffe2-6f75-4158-9482-38c763b23d77 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df" status: 200 len: 353 microversion: 2.1 time: 0.172106 Aug 10 11:22:28.887931 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 2/2] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:28 2022] GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:29.837595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fcd425af-dcff-4bc9-abc9-ed3fbaa6d16f tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.023621 Aug 10 11:22:29.838244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1155 bytes} [Wed Aug 10 11:22:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4026 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 11:22:29.852902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d8f5d852-2023-4b5f-91b9-bbf924467f70 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466f4310>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:29.902886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-47e30533-5d2f-4963-a4b6-ad42a0fba7a3 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Calling method '.version_select at 0x7f6f467a8d30>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:29.992909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d8f5d852-2023-4b5f-91b9-bbf924467f70 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06" status: 200 len: 345 microversion: 2.1 time: 0.143721 Aug 10 11:22:29.993482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:29 2022] GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:30.020202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-47e30533-5d2f-4963-a4b6-ad42a0fba7a3 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df" status: 200 len: 353 microversion: 2.1 time: 0.122074 Aug 10 11:22:30.026296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 2/5] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:29 2022] GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:31.006779 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c3435fb4-b6ff-47e1-8852-04b86b37023e tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466f4a60>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:31.034755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7bc3d17f-f83b-4495-86a4-94d2464a1f79 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Calling method '.version_select at 0x7f6f47062040>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:31.175499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c3435fb4-b6ff-47e1-8852-04b86b37023e tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06" status: 200 len: 345 microversion: 2.1 time: 0.172497 Aug 10 11:22:31.181476 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7bc3d17f-f83b-4495-86a4-94d2464a1f79 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df" status: 200 len: 354 microversion: 2.1 time: 0.142284 Aug 10 11:22:31.181600 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:31 2022] GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 => generated 345 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:31.181689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 3/7] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:31 2022] GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df => generated 354 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:31.196293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-62bf7051-8a62-478b-bcc8-a6e515f29d79 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Calling method '.version_select at 0x7f6f46752dc0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:31.320992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-62bf7051-8a62-478b-bcc8-a6e515f29d79 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df" status: 200 len: 354 microversion: 2.1 time: 0.131052 Aug 10 11:22:31.325926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 5/8] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:31 2022] GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:31.346385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-31525925-c105-4461-b6ac-74d77afca5db tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Calling method '.version_select at 0x7f6f466f4430>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:31.687928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-31525925-c105-4461-b6ac-74d77afca5db tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df" status: 202 len: 0 microversion: 2.1 time: 0.344202 Aug 10 11:22:31.687928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 4/9] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:22:31 2022] DELETE /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:22:31.695171 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-95c2f819-1b89-4967-ab6e-d12925f5e40c tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Calling method '.version_select at 0x7f6f466f4af0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:31.790337 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-95c2f819-1b89-4967-ab6e-d12925f5e40c tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df" status: 200 len: 353 microversion: 2.1 time: 0.098949 Aug 10 11:22:31.791179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:31 2022] GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:32.188609 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8d6ae9d2-b7c2-4b2e-9fd4-d00d9dadedd4 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466f4af0>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:32.283705 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8d6ae9d2-b7c2-4b2e-9fd4-d00d9dadedd4 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06" status: 200 len: 346 microversion: 2.1 time: 0.099172 Aug 10 11:22:32.285266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 5/11] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:32 2022] GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:32.313207 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-61ee4983-b151-4e0a-b23b-738248132763 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Action: 'create', calling method: .version_select at 0x7f6f466f43a0>, body: {"snapshot": {"volume_id": "610d605c-0adb-4943-8952-84fa48e6eb06", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1256035632"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:32.804439 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1f935cc1-d5d2-469c-8d6f-200b7bdfcc40 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Calling method '.version_select at 0x7f6f466f4b80>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:32.872081 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-1f935cc1-d5d2-469c-8d6f-200b7bdfcc40 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] HTTP exception thrown: Volume 3512505f-f6a8-4198-abe6-72bac861f2df could not be found. Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1f935cc1-d5d2-469c-8d6f-200b7bdfcc40 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Request method failure captured: Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df HTTP/1.1 Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85TxPgUqBnjbROe8d5J8u_6Yeq-Or79sfJMq87q2ydiRxs7gCIopphlqGttSOFCZTVOafixAliUECv98mAD-HEYo7gUSTZPkd4cqXijoPX2rOeb18BhQWCIQWNueH_j_mJjoU1i3LBPVd0aRoxsMEq61nr7UI2UqzRmYnaiBCD5ZbW4 Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: b50f3ae6a06943ee9cce4bb812cfa5d1 Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-VolumesGetTestJSON-1250352818 Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:22:32.877025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b50f3ae6a06943ee9cce4bb812cfa5d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b50f3ae6a06943ee9cce4bb812cfa5d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b50f3ae6a06943ee9cce4bb812cfa5d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b50f3ae6a06943ee9cce4bb812cfa5d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-VolumesGetTestJSON-1250352818 Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: b50f3ae6a06943ee9cce4bb812cfa5d1 Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-VolumesGetTestJSON-1250352818 Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-VolumesGetTestJSON-1250352818-project Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: c735731e1e3c4fbca8fab3960dd4b4c8 Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-VolumesGetTestJSON-1250352818-project Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Volume 3512505f-f6a8-4198-abe6-72bac861f2df could not be found. Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '3512505f-f6a8-4198-abe6-72bac861f2df'} Aug 10 11:22:32.878044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3512505f-f6a8-4198-abe6-72bac861f2df could not be found. (HTTP 404) (Request-ID: req-40f016cc-a25a-4910-9f92-badd3f72b256) Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:32.879785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:22:32.880658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3512505f-f6a8-4198-abe6-72bac861f2df could not be found. Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:22:32.881466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3512505f-f6a8-4198-abe6-72bac861f2df could not be found. Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3512505f-f6a8-4198-abe6-72bac861f2df could not be found. Aug 10 11:22:32.882307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:32.885795 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1f935cc1-d5d2-469c-8d6f-200b7bdfcc40 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] Returning 404 to user: Volume 3512505f-f6a8-4198-abe6-72bac861f2df could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:32.894681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1f935cc1-d5d2-469c-8d6f-200b7bdfcc40 tempest-VolumesGetTestJSON-1250352818 tempest-VolumesGetTestJSON-1250352818-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df" status: 404 len: 109 microversion: 2.1 time: 0.086545 Aug 10 11:22:32.894681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:32 2022] GET /compute/v2.1/os-volumes/3512505f-f6a8-4198-abe6-72bac861f2df => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:22:33.095739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-61ee4983-b151-4e0a-b23b-738248132763 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.788392 Aug 10 11:22:33.098257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 7/13] 10.222.0.13 () {60 vars in 1162 bytes} [Wed Aug 10 11:22:32 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:33.108527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-53036e1c-34cc-4f87-ac85-235af2833b30 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466f4670>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:33.399037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-53036e1c-34cc-4f87-ac85-235af2833b30 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 287 microversion: 2.1 time: 0.294910 Aug 10 11:22:33.407052 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 7/14] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:33 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 287 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:33.428777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bcac30cf-aa52-4e59-9af0-b534805b4550 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466f4160>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:33.532794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bcac30cf-aa52-4e59-9af0-b534805b4550 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.118056 Aug 10 11:22:33.541483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 8/15] 10.222.0.13 () {58 vars in 1140 bytes} [Wed Aug 10 11:22:33 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:33.546895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4a1abcc4-875a-4cc8-99b6-553bc7c94b90 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466cb670>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:33.616538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4a1abcc4-875a-4cc8-99b6-553bc7c94b90 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 287 microversion: 2.1 time: 0.075194 Aug 10 11:22:33.617401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:33 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:34.631934 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fdffc754-fb0e-42a4-bdbe-72638e0c2f1f tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f46752d30>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:34.694377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fdffc754-fb0e-42a4-bdbe-72638e0c2f1f tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 287 microversion: 2.1 time: 0.063306 Aug 10 11:22:34.695168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 9/17] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:34 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:35.272631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-452764934", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "networks": [{"uuid": "bcb2dec4-f8b8-490e-9f41-83632bcc49c4"}]}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:35.472512 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] validate_networks() for [('bcb2dec4-f8b8-490e-9f41-83632bcc49c4', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:22:35.787795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-710eb4c9-e48a-452f-941f-926fb22ea360 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466fa430>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:35.830139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-710eb4c9-e48a-452f-941f-926fb22ea360 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 287 microversion: 2.1 time: 0.126012 Aug 10 11:22:35.835807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 10/18] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:35 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:36.852190 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-660e2ebd-678a-4139-b3f5-a7a89a4ffe0c tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f46752b80>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:37.181110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-660e2ebd-678a-4139-b3f5-a7a89a4ffe0c tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 287 microversion: 2.1 time: 0.342146 Aug 10 11:22:37.187459 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 11/19] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:36 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 287 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:38.194091 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-96e6bb35-25ee-467c-83c5-6842cf78e73d tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466f4dc0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:38.504793 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-96e6bb35-25ee-467c-83c5-6842cf78e73d tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 287 microversion: 2.1 time: 0.314404 Aug 10 11:22:38.505364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 12/20] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:38 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 287 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:38.905171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:22:38.911733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:22:38.911733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:22:38.911733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:22:38.911733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:22:38.980562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:38.981068 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:38.982313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:38.986855 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:38.989624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:38.990325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:39.055749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Getting quotas for project ac78c80460af43e0aa28dc607af188d5. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:22:39.064302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Getting quotas for user 2386a816917a4c3d97f394b07d901386 and project ac78c80460af43e0aa28dc607af188d5. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:22:39.078859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:22:39.081960 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:22:39.346088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9baec6dc-219b-49a5-beec-ebbfcf22102c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.605902 Aug 10 11:22:39.348777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 9/21] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:22:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:22:39.359427 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-681ffc7a-0cea-45bc-9823-b46ec3760677 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:39.360614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-681ffc7a-0cea-45bc-9823-b46ec3760677 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:39.517752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7c5b1d44-a8d3-407d-a43e-1d85c45eb19f tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f45d588b0>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:39.598594 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7c5b1d44-a8d3-407d-a43e-1d85c45eb19f tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 287 microversion: 2.1 time: 0.084010 Aug 10 11:22:39.600048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 10/22] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:39 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:39.630264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-681ffc7a-0cea-45bc-9823-b46ec3760677 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:39.683423 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-681ffc7a-0cea-45bc-9823-b46ec3760677 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1214 microversion: 2.1 time: 0.325556 Aug 10 11:22:39.713143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 13/23] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:39 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1214 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:40.612496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4842e213-30d5-44dc-9091-5510654d4d1a tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f45d6a040>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:40.682687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4842e213-30d5-44dc-9091-5510654d4d1a tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 288 microversion: 2.1 time: 0.075833 Aug 10 11:22:40.684231 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:40 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:40.697725 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8f18ba12-dbe1-45fd-882c-dd4a49dc2fea tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466fadc0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:40.714614 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-72838566-a285-40a0-a4ed-034ef22a14a2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:40.715661 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-72838566-a285-40a0-a4ed-034ef22a14a2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:41.000838 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8f18ba12-dbe1-45fd-882c-dd4a49dc2fea tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 202 len: 0 microversion: 2.1 time: 0.309517 Aug 10 11:22:41.001586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1254 bytes} [Wed Aug 10 11:22:40 2022] DELETE /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:22:41.012078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-acccdf90-c881-496e-8e31-61cd77bc43fa tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466be940>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:41.070019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-acccdf90-c881-496e-8e31-61cd77bc43fa tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 200 len: 287 microversion: 2.1 time: 0.063031 Aug 10 11:22:41.070607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 15/26] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:41 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:22:41.263074 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-72838566-a285-40a0-a4ed-034ef22a14a2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:41.298624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-72838566-a285-40a0-a4ed-034ef22a14a2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1214 microversion: 2.1 time: 0.587749 Aug 10 11:22:41.302045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 12/27] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:40 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1214 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:22:41.688920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0ba161a6-873c-4fa8-8ecf-d60e1a49a3c9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'create', calling method: .version_select at 0x7f6f466bee50>, body: {"keypair": {"name": "tempest-keypair-313909988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdKiQyaZrEi1t8F2zBeSSwreNHwZTYEeHJE8jzlTWJLPQt2E13Q3ga/Dc1xUrpiW2ZLryV63vWG3SQ2/kkg9Y9EInF8FsDmt3sss5ec1QJEcjygZaqbkx0ZC6NPXoUprA=="}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:41.807033 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-0ba161a6-873c-4fa8-8ecf-d60e1a49a3c9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Getting quotas for project 362ec4487088496a8198a3cf71815256. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:22:41.813108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-0ba161a6-873c-4fa8-8ecf-d60e1a49a3c9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Getting quotas for user 11be37af210c45fc9ddebf7f28b265ef and project 362ec4487088496a8198a3cf71815256. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:22:42.044164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0ba161a6-873c-4fa8-8ecf-d60e1a49a3c9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.547846 Aug 10 11:22:42.046422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 16/28] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:22:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:42.084798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dcd79633-2a13-44f7-aa8b-315c11c778da tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f45d6ac10>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:42.162883 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-dcd79633-2a13-44f7-aa8b-315c11c778da tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] HTTP exception thrown: Snapshot d8044338-2bbf-4cfc-a2e9-bf4ada55b411 could not be found. Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dcd79633-2a13-44f7-aa8b-315c11c778da tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Request method failure captured: Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 HTTP/1.1 Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85TxCEOdRnW19N5tUySvexjX-F5u38Sw1lHWiUjsAl8d9KIZbun0wP7Y0zRUIdfkNV6M-xYA5k1SFWYLuvcU_eTIXyR8I54_Z7Hd_281RU-A_IA0-vxZZ51p6VtozzGis54W4xPj6SxUT2YPoIP3Hz8mwgk5-l58UEm92l-rRggVQdc Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: f19ad3068694411f9808277a34994ea2 Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:22:42.165667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19ad3068694411f9808277a34994ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f19ad3068694411f9808277a34994ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19ad3068694411f9808277a34994ea2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f19ad3068694411f9808277a34994ea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: f19ad3068694411f9808277a34994ea2 Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-VolumesSnapshotsTestJSON-1891040724-project Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 6fbb043908dd4807b55c4c063105c26b Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1891040724-project Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Snapshot d8044338-2bbf-4cfc-a2e9-bf4ada55b411 could not be found. Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'd8044338-2bbf-4cfc-a2e9-bf4ada55b411'} Aug 10 11:22:42.166812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d8044338-2bbf-4cfc-a2e9-bf4ada55b411 could not be found. (HTTP 404) (Request-ID: req-9a9efcf5-b077-4a91-9319-e550cae7872f) Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:42.167478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:22:42.178479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d8044338-2bbf-4cfc-a2e9-bf4ada55b411 could not be found. Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 11:22:42.179727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d8044338-2bbf-4cfc-a2e9-bf4ada55b411 could not be found. Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d8044338-2bbf-4cfc-a2e9-bf4ada55b411 could not be found. Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dcd79633-2a13-44f7-aa8b-315c11c778da tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Returning 404 to user: Snapshot d8044338-2bbf-4cfc-a2e9-bf4ada55b411 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:42.180956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dcd79633-2a13-44f7-aa8b-315c11c778da tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411" status: 404 len: 111 microversion: 2.1 time: 0.090521 Aug 10 11:22:42.181688 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 13/29] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:22:42 2022] GET /compute/v2.1/os-snapshots/d8044338-2bbf-4cfc-a2e9-bf4ada55b411 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:42.185123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-43c29d47-8894-4515-8063-ab69bfecdde6 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f4664d040>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:42.348666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6a94da14-126e-4535-92c5-62af5a518a70 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:42.349649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6a94da14-126e-4535-92c5-62af5a518a70 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:42.526068 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6a94da14-126e-4535-92c5-62af5a518a70 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:42.535458 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6a94da14-126e-4535-92c5-62af5a518a70 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1214 microversion: 2.1 time: 0.200031 Aug 10 11:22:42.551314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 14/30] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:42 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:42.586259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-43c29d47-8894-4515-8063-ab69bfecdde6 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06" status: 202 len: 0 microversion: 2.1 time: 0.410170 Aug 10 11:22:42.586841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 17/31] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:22:42 2022] DELETE /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:22:42.598655 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a7ba9f54-2b1c-4af4-a46d-b47345e6a876 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f466f4a60>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:42.698593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a7ba9f54-2b1c-4af4-a46d-b47345e6a876 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06" status: 200 len: 345 microversion: 2.1 time: 0.104753 Aug 10 11:22:42.708780 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 15/32] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:42 2022] GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:43.565727 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:43.565727 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:43.581389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:43.584810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:43.588665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:43.592491 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:43.595850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:43.599835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:43.716589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6a9894ed-8e5b-4ef8-a1e4-74ce315c07b3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f4551cd30>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:43.797176 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-6a9894ed-8e5b-4ef8-a1e4-74ce315c07b3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] HTTP exception thrown: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6a9894ed-8e5b-4ef8-a1e4-74ce315c07b3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Request method failure captured: Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 HTTP/1.1 Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85TxCEOdRnW19N5tUySvexjX-F5u38Sw1lHWiUjsAl8d9KIZbun0wP7Y0zRUIdfkNV6M-xYA5k1SFWYLuvcU_eTIXyR8I54_Z7Hd_281RU-A_IA0-vxZZ51p6VtozzGis54W4xPj6SxUT2YPoIP3Hz8mwgk5-l58UEm92l-rRggVQdc Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: f19ad3068694411f9808277a34994ea2 Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:22:43.799360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19ad3068694411f9808277a34994ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f19ad3068694411f9808277a34994ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19ad3068694411f9808277a34994ea2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f19ad3068694411f9808277a34994ea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: f19ad3068694411f9808277a34994ea2 Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-VolumesSnapshotsTestJSON-1891040724-project Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 6fbb043908dd4807b55c4c063105c26b Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1891040724-project Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '610d605c-0adb-4943-8952-84fa48e6eb06'} Aug 10 11:22:43.800675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. (HTTP 404) (Request-ID: req-3c241088-11fd-4522-8482-a8b5ac1097d4) Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:43.801572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:22:43.802666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:22:43.803752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.804870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.808597 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6a9894ed-8e5b-4ef8-a1e4-74ce315c07b3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Returning 404 to user: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:43.809665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6a9894ed-8e5b-4ef8-a1e4-74ce315c07b3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06" status: 404 len: 109 microversion: 2.1 time: 0.097853 Aug 10 11:22:43.810414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 16/33] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:43 2022] GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:43.834660 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-09cc79cd-dfce-4420-926e-643d1f9aa2f3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f45d58e50>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:43.927482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-09cc79cd-dfce-4420-926e-643d1f9aa2f3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] HTTP exception thrown: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-09cc79cd-dfce-4420-926e-643d1f9aa2f3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Request method failure captured: Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: DELETE /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 HTTP/1.1 Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85TxCEOdRnW19N5tUySvexjX-F5u38Sw1lHWiUjsAl8d9KIZbun0wP7Y0zRUIdfkNV6M-xYA5k1SFWYLuvcU_eTIXyR8I54_Z7Hd_281RU-A_IA0-vxZZ51p6VtozzGis54W4xPj6SxUT2YPoIP3Hz8mwgk5-l58UEm92l-rRggVQdc Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: f19ad3068694411f9808277a34994ea2 Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:22:43.933708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19ad3068694411f9808277a34994ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f19ad3068694411f9808277a34994ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19ad3068694411f9808277a34994ea2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f19ad3068694411f9808277a34994ea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: f19ad3068694411f9808277a34994ea2 Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-VolumesSnapshotsTestJSON-1891040724-project Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 6fbb043908dd4807b55c4c063105c26b Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1891040724-project Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '610d605c-0adb-4943-8952-84fa48e6eb06'} Aug 10 11:22:43.934880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. (HTTP 404) (Request-ID: req-c1322375-8611-49ad-979a-ab66d06854fb) Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:43.935687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:22:43.936926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:22:43.938214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-09cc79cd-dfce-4420-926e-643d1f9aa2f3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Returning 404 to user: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:43.939672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-09cc79cd-dfce-4420-926e-643d1f9aa2f3 tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06" status: 404 len: 109 microversion: 2.1 time: 0.107112 Aug 10 11:22:43.954238 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 17/34] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:22:43 2022] DELETE /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:44.162774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:44.182897 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f4592c5f-565e-488d-891e-e6582e6619f3 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1210 microversion: 2.1 time: 0.625790 Aug 10 11:22:44.190902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 18/35] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:43 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1210 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:44.209605 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b186726d-f2dd-40cd-a93a-dffe2b4725ea tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Calling method '.version_select at 0x7f6f45d55700>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:44.273270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-b186726d-f2dd-40cd-a93a-dffe2b4725ea tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] HTTP exception thrown: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b186726d-f2dd-40cd-a93a-dffe2b4725ea tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Request method failure captured: Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 HTTP/1.1 Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85TxCEOdRnW19N5tUySvexjX-F5u38Sw1lHWiUjsAl8d9KIZbun0wP7Y0zRUIdfkNV6M-xYA5k1SFWYLuvcU_eTIXyR8I54_Z7Hd_281RU-A_IA0-vxZZ51p6VtozzGis54W4xPj6SxUT2YPoIP3Hz8mwgk5-l58UEm92l-rRggVQdc Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: f19ad3068694411f9808277a34994ea2 Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:22:44.277520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19ad3068694411f9808277a34994ea2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f19ad3068694411f9808277a34994ea2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f19ad3068694411f9808277a34994ea2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f19ad3068694411f9808277a34994ea2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: f19ad3068694411f9808277a34994ea2 Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1891040724 Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesSnapshotsTestJSON-1891040724-project Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 6fbb043908dd4807b55c4c063105c26b Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1891040724-project Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '610d605c-0adb-4943-8952-84fa48e6eb06'} Aug 10 11:22:44.278777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. (HTTP 404) (Request-ID: req-932e09e2-28c8-430a-8125-216b05293bd6) Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:44.279628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:22:44.280690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:22:44.284714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b186726d-f2dd-40cd-a93a-dffe2b4725ea tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] Returning 404 to user: Volume 610d605c-0adb-4943-8952-84fa48e6eb06 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b186726d-f2dd-40cd-a93a-dffe2b4725ea tempest-VolumesSnapshotsTestJSON-1891040724 tempest-VolumesSnapshotsTestJSON-1891040724-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06" status: 404 len: 109 microversion: 2.1 time: 0.088440 Aug 10 11:22:44.286607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 19/36] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:22:44 2022] GET /compute/v2.1/os-volumes/610d605c-0adb-4943-8952-84fa48e6eb06 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:22:44.288078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-044da5eb-300a-492e-b30a-0bb51b609896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'create', calling method: .version_select at 0x7f6f4551c040>, body: {"keypair": {"name": "tempest-keypair-1272878655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh78k9dNeJNcuMgECQ1xRqFQ9PZGxs9GWUs/8kts6x2RKNtgaj9vg2j5IsalEFiDjsSTssTKrhj/sn8CRcqC4VA6sMNq/zgvtfmafDOJPS/kFXr6EGQiYzIae9LKfNeug=="}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:44.383685 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-044da5eb-300a-492e-b30a-0bb51b609896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Getting quotas for project 282c9e4b65d64085a0ba1a3d356f59fa. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:22:44.395833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-044da5eb-300a-492e-b30a-0bb51b609896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Getting quotas for user 87adb637dd814cf8be9ff6c2a2bc26ea and project 282c9e4b65d64085a0ba1a3d356f59fa. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:22:44.582250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-044da5eb-300a-492e-b30a-0bb51b609896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.629341 Aug 10 11:22:44.582250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 18/37] 10.222.0.13 () {62 vars in 1200 bytes} [Wed Aug 10 11:22:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 632 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 11:22:45.219088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:45.220373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:45.233517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:45.233517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:45.233517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:45.236399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:45.237769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:45.239719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:45.612898 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:45.653013 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d5fcde83-ab02-4224-b2bb-2eb06fa8c131 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1274 microversion: 2.1 time: 0.438563 Aug 10 11:22:45.653627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 20/38] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:45 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1274 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:46.677301 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:46.678002 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:46.695524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:46.696009 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:46.696499 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:46.697239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:46.697699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:46.698387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:48.030985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-34aff935-17c3-4c84-b367-84fc5ea1c87a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: .version_select at 0x7f6f45d08670>, body: {"keypair": {"name": "tempest-keypair-2132828086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZ1WbNGNbEV9pcewkp/51GZhde+q5QKVFQGRQYNzGunxwqlIENY7lNN2C99ApXSISkYemZg7Wwg0ZYio6rKEywjEohgfVyB3F6IW43tTdWgqHp7+DVHxAitt7As/sn+/w=="}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:48.137389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-34aff935-17c3-4c84-b367-84fc5ea1c87a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:22:48.167776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-34aff935-17c3-4c84-b367-84fc5ea1c87a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for user 0782e27e2318438fbf155dfa9cb834b6 and project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:22:48.264918 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:48.294171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c90bc903-465c-4183-a6b2-b67fc55ab905 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1272 microversion: 2.1 time: 1.620850 Aug 10 11:22:48.318362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 19/39] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:46 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1272 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:48.406006 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-34aff935-17c3-4c84-b367-84fc5ea1c87a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.725729 Aug 10 11:22:48.407289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:22:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:48.800990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1605604671", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:48.961992 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] validate_networks() for [('e250d256-e01c-4e22-9b87-b8c02fd3002e', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:22:49.036718 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:49.325061 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:49.329806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:49.351733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:49.352549 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:49.353151 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:49.355273 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:49.370643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:49.373863 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:50.043336 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:50.055882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-714ad4ca-b03f-468a-aa22-52ed1c61fc09 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1272 microversion: 2.1 time: 0.738229 Aug 10 11:22:50.060341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 22/41] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:49 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1272 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:51.090330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:51.092303 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:51.117177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.118923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.124974 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.126085 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.130303 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.134354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.513460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:22:51.563735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:22:51.563735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:22:51.563735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:22:51.563735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:22:51.595978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.596565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.599495 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.600317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:51.600789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:51.601223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:51.647560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Getting quotas for project 526e4ff2ae594d54a53e628df8802a92. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:22:51.653841 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Getting quotas for user 9b5890ee9a114299b0a15a6608503632 and project 526e4ff2ae594d54a53e628df8802a92. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:22:51.668616 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:22:51.671778 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:22:51.862290 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:51.874969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-739ee18d-e5ee-4a03-bd77-8dbfc4c76890 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.789573 Aug 10 11:22:51.897609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 23/42] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:51 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:52.027574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ed482fd0-615d-4905-9d27-a650b11c6c49 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.695904 Aug 10 11:22:52.032614 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 20/43] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:22:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 3697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:22:52.054752 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fe578dcc-4f15-4267-b2c9-1150d7c209ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:52.055389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fe578dcc-4f15-4267-b2c9-1150d7c209ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:52.354201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fe578dcc-4f15-4267-b2c9-1150d7c209ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:52.372999 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fe578dcc-4f15-4267-b2c9-1150d7c209ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1222 microversion: 2.1 time: 0.336268 Aug 10 11:22:52.403457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 24/44] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:52 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:52.679077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1794969225", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:52.841697 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] validate_networks() for [('e250d256-e01c-4e22-9b87-b8c02fd3002e', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:22:52.903710 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:52.912658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:52.916862 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:52.917366 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:52.917797 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:52.918502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:52.918949 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:52.922908 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:54.157068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:54.174671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-062042b7-f853-450c-b8ab-2ffeb7b80c1d tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 1.276068 Aug 10 11:22:54.178070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 25/45] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:52 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:22:54.183919 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2085167917", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42f526d8-2583-44b1-91be-b1dd0d8b867f"}], "security_groups": [{"name": "tempest-securitygroup--2127888452"}], "key_name": "tempest-keypair-313909988", "user_data": "}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:54.603516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] validate_networks() for [('42f526d8-2583-44b1-91be-b1dd0d8b867f', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:22:55.461866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:22:55.467474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:22:55.468877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:22:55.471321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:22:55.473329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:22:55.514707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:55.516318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:55.528048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:55.535541 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:55.537382 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:55.539331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:55.620200 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Getting quotas for project 526e4ff2ae594d54a53e628df8802a92. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:22:55.636722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Getting quotas for user 9b5890ee9a114299b0a15a6608503632 and project 526e4ff2ae594d54a53e628df8802a92. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:22:55.657970 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:22:55.660137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:22:56.202169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9abfcc4d-8e5b-4a7a-9212-46ede3bd2f03 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.517537 Aug 10 11:22:56.202169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 21/46] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:22:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 3528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:22:56.213712 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:56.216299 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:56.241560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:56.242319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:56.242916 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:56.244441 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:56.245059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:56.245642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:57.038184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:57.070993 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-473262ac-6914-4a99-9ac1-0bd8c20f6a68 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.862246 Aug 10 11:22:57.078829 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 22/47] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:56 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:57.108566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ec0210a2-80f5-47d6-acd9-5dd3874e7ce4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:57.110854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ec0210a2-80f5-47d6-acd9-5dd3874e7ce4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:57.120139 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=10 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:22:57.361660 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ec0210a2-80f5-47d6-acd9-5dd3874e7ce4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:57.368971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ec0210a2-80f5-47d6-acd9-5dd3874e7ce4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1222 microversion: 2.1 time: 0.288795 Aug 10 11:22:57.369554 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:57 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1222 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:58.100623 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:58.110074 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:58.124952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:58.127284 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:58.128525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:58.131161 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:58.133692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:58.135462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:58.151138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:22:58.151767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:22:58.152270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:22:58.152680 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:22:58.153085 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:22:58.180184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:58.182479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:58.183568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:58.186612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:58.188042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:58.189428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:58.300107 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Getting quotas for project 362ec4487088496a8198a3cf71815256. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:22:58.321022 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Getting quotas for user 11be37af210c45fc9ddebf7f28b265ef and project 362ec4487088496a8198a3cf71815256. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:22:58.347563 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:22:58.354328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:22:58.707753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d63c75c5-4646-4fb4-8c5e-4903951d1623 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.528268 Aug 10 11:22:58.720995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 26/49] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:22:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 4542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:22:58.896515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:58.923404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b6c69d3b-a8a4-4f8e-8194-a1d5b3513f8b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.824839 Aug 10 11:22:58.927789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 24/50] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:58 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:22:58.974270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-25d0abac-65a3-4bcd-a026-4daf34494ad3 req-c598ca68-6ea7-404b-bb30-261a777e63d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd03df2-abc5-42f9-907e-ed5d88f1c45f", "tag": "f2971658-7d3d-409f-b328-e6511852a8bd"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:58.974403 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2069473278", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24c11727-9280-4b85-b477-78482251b877"}], "security_groups": [{"name": "tempest-securitygroup--1092180227"}], "key_name": "tempest-keypair-2132828086", "user_data": "}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:59.014598 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-25d0abac-65a3-4bcd-a026-4daf34494ad3 req-c598ca68-6ea7-404b-bb30-261a777e63d6 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:59.016425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-25d0abac-65a3-4bcd-a026-4daf34494ad3 req-c598ca68-6ea7-404b-bb30-261a777e63d6 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:59.017821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-25d0abac-65a3-4bcd-a026-4daf34494ad3 req-c598ca68-6ea7-404b-bb30-261a777e63d6 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:59.085333 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-25d0abac-65a3-4bcd-a026-4daf34494ad3 req-c598ca68-6ea7-404b-bb30-261a777e63d6 service nova] Creating event network-changed:f2971658-7d3d-409f-b328-e6511852a8bd for instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f on hv-cinder-85061 Aug 10 11:22:59.089265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-25d0abac-65a3-4bcd-a026-4daf34494ad3 req-c598ca68-6ea7-404b-bb30-261a777e63d6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 11:22:59.090190 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-25d0abac-65a3-4bcd-a026-4daf34494ad3 req-c598ca68-6ea7-404b-bb30-261a777e63d6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 11:22:59.091527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:59.094210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:59.097390 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:59.100137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:59.100659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:59.101069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:59.118168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.compute.rpcapi [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 11:22:59.128021 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] Releasing lock "compute-rpcapi-router" {{(pid=118426) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 11:22:59.183076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-32818158-afca-43bd-a0d0-34d614dafa99 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.459495 Aug 10 11:22:59.185908 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 27/51] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:22:59.206634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:22:59.207498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:22:59.222512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:59.222512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:59.222512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:59.222512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:22:59.222855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:22:59.222855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:22:59.278226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] validate_networks() for [('24c11727-9280-4b85-b477-78482251b877', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:22:59.552686 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:22:59.569593 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-79062b45-a31b-4b56-9c74-ca735acfbdad tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1218 microversion: 2.1 time: 0.378644 Aug 10 11:22:59.570101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 28/52] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:22:59 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1218 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:22:59.598454 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-186195824", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62e8cbda-6c30-4481-8081-da5b43bd3e56"}], "security_groups": [{"name": "tempest-securitygroup--1321710955"}], "key_name": "tempest-keypair-1272878655", "user_data": "}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:22:59.975718 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] validate_networks() for [('62e8cbda-6c30-4481-8081-da5b43bd3e56', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:23:01.072283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:23:01.073614 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:23:01.074303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:23:01.074934 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:23:01.075621 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:23:01.092717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:01.094448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:01.094448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:01.104542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:01.105441 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:01.106296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:01.144385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:23:01.149866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for user 0782e27e2318438fbf155dfa9cb834b6 and project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:23:01.170617 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:23:01.191066 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:23:01.503354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2edaf6be-eb6e-4ec5-bef3-975f33d468e4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.573520 Aug 10 11:23:01.512755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 25/53] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:22:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:23:01.518557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:01.527016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:01.548036 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:01.548645 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:01.559853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:01.559853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:01.559853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:01.559853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.094464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.104699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b1eb715c-b73f-4b81-9b3d-3d22056fe5b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1233 microversion: 2.1 time: 0.590447 Aug 10 11:23:02.122084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 26/54] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:01 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1233 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:02.127872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:02.132515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:02.148960 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:02.149813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:02.150458 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.151366 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:02.152031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:02.152649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.368191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:23:02.369662 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:23:02.370361 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:23:02.371920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:23:02.372623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:23:02.386145 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:02.386995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:02.387701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.391355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:02.392031 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:02.405428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.430374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Getting quotas for project 282c9e4b65d64085a0ba1a3d356f59fa. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:23:02.434298 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.438613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Getting quotas for user 87adb637dd814cf8be9ff6c2a2bc26ea and project 282c9e4b65d64085a0ba1a3d356f59fa. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:23:02.443812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-90f1afed-b2e0-4143-881a-a77eda970a71 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.320294 Aug 10 11:23:02.444491 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 27/55] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:02 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:02.459779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:02.460409 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:02.472715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:02.473205 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:02.473324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:23:02.473634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.474324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:02.474770 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:02.475187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:02.475488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:23:02.573371 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.588870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5e302aa4-f113-475f-a8a5-6d275b1b66c7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1280 microversion: 2.1 time: 0.142046 Aug 10 11:23:02.593941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 28/56] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:02 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:02.607272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-083db8f6-e651-4de0-9efd-4cdd42fe86a5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:02.616994 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-083db8f6-e651-4de0-9efd-4cdd42fe86a5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:02.689153 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8749ec36-421d-470d-9bec-5a570b187315 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.117165 Aug 10 11:23:02.692505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 29/57] 10.222.0.13 () {62 vars in 1188 bytes} [Wed Aug 10 11:22:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3122 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 11:23:02.702025 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-745fd36a-4c44-4f55-bd1d-a67dfbb5f95f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:02.702645 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-745fd36a-4c44-4f55-bd1d-a67dfbb5f95f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:02.840776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-083db8f6-e651-4de0-9efd-4cdd42fe86a5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.849490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-083db8f6-e651-4de0-9efd-4cdd42fe86a5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1242 microversion: 2.1 time: 0.252488 Aug 10 11:23:02.850956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:02 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1242 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:02.922733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-745fd36a-4c44-4f55-bd1d-a67dfbb5f95f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.930992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-745fd36a-4c44-4f55-bd1d-a67dfbb5f95f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.937295 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-745fd36a-4c44-4f55-bd1d-a67dfbb5f95f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:02.938332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-745fd36a-4c44-4f55-bd1d-a67dfbb5f95f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1281 microversion: 2.20 time: 0.241170 Aug 10 11:23:02.938897 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 30/59] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:02 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:03.130212 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:03.130830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:03.140773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.141489 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.141931 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.147530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.148062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.149502 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.293101 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:03.307614 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d4017eb3-641b-4953-8d81-804085bbcef1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1289 microversion: 2.1 time: 0.180385 Aug 10 11:23:03.309589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 30/60] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:03 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1289 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:03.471070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:03.474004 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:03.480761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.481567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.482259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.483273 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.484288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.484902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.617929 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-eb012449-91cd-4db0-8d27-6d83728c33ff req-a2b355d8-381f-401f-b655-9880282e3a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7efa0d4f-5ba3-4b0b-a331-ce5dab394d80", "tag": "9fb59bc9-c4a4-4e37-b37f-b173da2c56f4"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:03.679195 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-eb012449-91cd-4db0-8d27-6d83728c33ff req-a2b355d8-381f-401f-b655-9880282e3a72 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.683378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-eb012449-91cd-4db0-8d27-6d83728c33ff req-a2b355d8-381f-401f-b655-9880282e3a72 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.684829 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-eb012449-91cd-4db0-8d27-6d83728c33ff req-a2b355d8-381f-401f-b655-9880282e3a72 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.737332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-eb012449-91cd-4db0-8d27-6d83728c33ff req-a2b355d8-381f-401f-b655-9880282e3a72 service nova] Creating event network-changed:9fb59bc9-c4a4-4e37-b37f-b173da2c56f4 for instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 on hv-cinder-85061 Aug 10 11:23:03.738099 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-eb012449-91cd-4db0-8d27-6d83728c33ff req-a2b355d8-381f-401f-b655-9880282e3a72 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 11:23:03.739950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-eb012449-91cd-4db0-8d27-6d83728c33ff req-a2b355d8-381f-401f-b655-9880282e3a72 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 11:23:03.739950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.740737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.741332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.774370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.775249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.775841 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.789845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.compute.rpcapi [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 11:23:03.791185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] Releasing lock "compute-rpcapi-router" {{(pid=118425) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 11:23:03.818098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-609783d7-da5e-4446-a85c-5fdfd5d802d7 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271574 Aug 10 11:23:03.822531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 31/61] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:03.844374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:03.846784 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:03.876380 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.879069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.879595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:03.881753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:03.885085 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:03.885461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:04.010124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.019109 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d21e09cc-a763-47a2-9684-2a798cc4d8d4 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.553725 Aug 10 11:23:04.041282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 31/62] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:03 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:04.046496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:04.064027 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:04.088740 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:04.089503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:04.090085 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:04.093069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:04.093737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:04.094340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:04.300284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.313032 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e52e1dbf-4a70-4ecd-9c6c-f9776083319b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1246 microversion: 2.1 time: 0.265338 Aug 10 11:23:04.315189 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 32/63] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:04 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1246 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:04.356761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d8d312af-c464-444e-88dc-4adaec355f7a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:04.356761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d8d312af-c464-444e-88dc-4adaec355f7a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:04.470920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d8d312af-c464-444e-88dc-4adaec355f7a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.479779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.490630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a90101e3-1eb1-4bd6-a8ab-dd2d799a0cbf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.665129 Aug 10 11:23:04.493061 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 32/64] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:03 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:04.507505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d8d312af-c464-444e-88dc-4adaec355f7a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.508152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:04.508152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:04.508308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d8d312af-c464-444e-88dc-4adaec355f7a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.508308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d8d312af-c464-444e-88dc-4adaec355f7a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1281 microversion: 2.20 time: 0.186297 Aug 10 11:23:04.508308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:04 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1281 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:04.520439 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:04.520939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:04.521378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:04.522086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:04.524580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:04.525163 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:04.631531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:04.646419 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f37b03f2-2fdf-4217-93b1-fccae2615133 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1297 microversion: 2.1 time: 0.151371 Aug 10 11:23:04.647786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 33/66] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:04 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:05.051905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.052549 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:05.058515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.059004 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.059425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.060156 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.061971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.062414 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.259091 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.267010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-cfd56934-61c1-46c5-b9c2-ca5d93137020 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.218984 Aug 10 11:23:05.267650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 34/67] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:05 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:05.343120 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.343878 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:05.350073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.350595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.350978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.351700 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.352141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.352870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.431530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-ce95ee21-8438-4dbf-a214-6dcce530c16e req-7705b2fe-3ea0-4d01-9acf-60af12172aef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1dee8fd-096f-489c-a67b-dee7491702ad", "tag": "fbf08147-0d64-437e-af90-de99285a3fd7"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:05.447930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ce95ee21-8438-4dbf-a214-6dcce530c16e req-7705b2fe-3ea0-4d01-9acf-60af12172aef service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.449693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ce95ee21-8438-4dbf-a214-6dcce530c16e req-7705b2fe-3ea0-4d01-9acf-60af12172aef service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.450138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ce95ee21-8438-4dbf-a214-6dcce530c16e req-7705b2fe-3ea0-4d01-9acf-60af12172aef service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.470257 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.478430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9e06ae7c-f468-433b-b79f-25c3e9b2c801 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1238 microversion: 2.1 time: 0.140871 Aug 10 11:23:05.484278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 34/68] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:05 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1238 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:05.498529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-ce95ee21-8438-4dbf-a214-6dcce530c16e req-7705b2fe-3ea0-4d01-9acf-60af12172aef service nova] Creating event network-changed:fbf08147-0d64-437e-af90-de99285a3fd7 for instance e1dee8fd-096f-489c-a67b-dee7491702ad on hv-cinder-85061 Aug 10 11:23:05.510308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-ce95ee21-8438-4dbf-a214-6dcce530c16e req-7705b2fe-3ea0-4d01-9acf-60af12172aef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082767 Aug 10 11:23:05.514561 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 35/69] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:23:05.534884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.535497 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:05.541400 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.543768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:05.553501 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.554616 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:05.556612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.557290 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.557950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.558529 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.559109 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.559970 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.561217 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.561865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.562750 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.563245 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.569087 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.698925 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.708078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.711064 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.712751 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c61b8c36-3fc9-4e77-a1d7-364253b47411 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1285 microversion: 2.20 time: 0.175088 Aug 10 11:23:05.713377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:05 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:05.719144 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:05.719837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:05.725747 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.726442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.726912 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.727690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:05.728322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:05.728737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:05.809621 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.813008 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:05.821079 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c2028494-ecd2-4518-b601-3eab2bda9ff2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1297 microversion: 2.1 time: 0.106397 Aug 10 11:23:05.821948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 37/71] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:05 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:05.823085 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0072a622-f4e3-4c9e-a42c-1cdf02fe5a5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.291993 Aug 10 11:23:05.832027 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 35/72] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:05 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:06.289039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:06.289643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:06.295887 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.296582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.297224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.297980 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.298608 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.299123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.503574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:06.504233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:06.510383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.511132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.511286 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.512265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.512708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.513144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.613132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:06.621082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-93f962aa-0303-4e48-a800-39125ac14f81 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1238 microversion: 2.1 time: 0.121699 Aug 10 11:23:06.621727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 36/73] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:06 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1238 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:06.641274 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:06.654787 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bbcceb54-fe2d-451a-bbd1-f4109bfeb859 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.369558 Aug 10 11:23:06.655373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 38/74] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:06 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:06.737250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:06.737855 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:06.743787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.744291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.744721 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.745397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.745842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.746303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.751146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=85 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:06.808345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:06.817981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:06.819479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:06.820633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-242223a6-03b3-46b8-b804-9df1f40901e5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1285 microversion: 2.20 time: 0.087242 Aug 10 11:23:06.821322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 37/75] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:06 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:06.844734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:06.845515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:06.846026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:06.847771 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:06.855452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.866016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.866906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.870817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.870817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.870817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.871094 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.871188 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.871279 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:06.871367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.871447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:06.871447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:06.930222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=83 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:07.080937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:07.098613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-80adaf61-0c16-4f45-ae96-f58fe22bccd3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1297 microversion: 2.1 time: 0.259755 Aug 10 11:23:07.111932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:06 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1297 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:07.410689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:07.428822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-837da331-b1e0-46ef-a6d1-e713795b7c4f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.587982 Aug 10 11:23:07.442256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 38/77] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:06 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:07.645233 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:07.647163 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:07.676616 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:07.677772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:07.678208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:07.679141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:07.679607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:07.680096 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:07.681117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:07.681910 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:07.699739 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:07.702733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:07.706184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:07.709867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:07.713356 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:07.714817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:07.880317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:07.894129 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-406a66a7-3a36-4993-915f-2d18c54b2956 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1294 microversion: 2.1 time: 0.254352 Aug 10 11:23:07.895044 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 40/78] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:07 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1294 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:07.906801 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:07.911015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:07.930119 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:07.936183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:07.936183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:07.936183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:07.936183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:07.936626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:07.978398 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:07.992673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d9d517e9-7a46-43a0-be66-d14dd7024aef tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.319627 Aug 10 11:23:08.004048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 39/79] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:07 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:08.031213 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:08.057519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:08.061706 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:08.063097 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-47f23eb7-bf76-487d-823e-65f24fea672c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1333 microversion: 2.20 time: 0.165755 Aug 10 11:23:08.070421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 41/80] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:07 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1333 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:08.119935 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:08.120572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:08.142780 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:08.159017 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:08.163191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:08.163191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:08.163191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:08.163191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:08.309342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:08.324658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c3f61de0-9e83-4a42-9d61-b1f64c03836b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1295 microversion: 2.1 time: 0.208995 Aug 10 11:23:08.325252 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 40/81] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:08 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1295 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:08.453080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:08.454266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:08.464557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:08.465137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:08.467959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:08.467959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:08.467959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:08.468515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:08.921171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:08.921783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:08.927961 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:08.929584 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:08.930315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:08.931195 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:08.932222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:08.932825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:09.270532 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:09.282991 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-45476a32-8e88-437a-a575-df0222acbfc9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.836435 Aug 10 11:23:09.301998 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 42/82] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:08 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:09.307139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:09.308144 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:09.315393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:09.316332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:09.316958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:09.317550 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:09.318445 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:09.319049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:09.319623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:09.333666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e1376955-664b-46b1-a25e-0a86d897237b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1300 microversion: 2.1 time: 0.411991 Aug 10 11:23:09.335830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 41/83] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:08 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1300 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:09.361928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:09.362851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:09.385801 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:09.386640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:09.387891 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:09.390546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:09.391170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:09.395326 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:09.539201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:09.546121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:09.548129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:09.549395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5f5a45ae-a231-4d2e-a785-29820ee9b569 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1339 microversion: 2.20 time: 0.211345 Aug 10 11:23:09.550088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 42/84] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:09 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1339 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:09.555244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:09.556289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:09.564111 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:09.564975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:09.565549 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:09.566666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:09.567255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:09.567813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:09.808582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:09.820036 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0548fb9f-cf68-4d84-af3b-6b066599b39a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.516629 Aug 10 11:23:09.820625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 43/85] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:09 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:09.991779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.016173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f3b19f1a-bf92-4a63-96fd-dfb67d5763cc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.464844 Aug 10 11:23:10.016770 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 43/86] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:09 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:10.306619 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:10.311817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:10.324544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.325043 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.325475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.326351 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.326801 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.327385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.358333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:10.358941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:10.366666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.367259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.367711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.368417 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.373129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.375532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.655549 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.665652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-aa0baada-1193-4042-a7a8-30c5bbbb12c5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.362472 Aug 10 11:23:10.679718 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.681320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 44/87] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:10 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:10.689737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:10.690556 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:10.699847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.700618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.701814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.702582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.703251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.703700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.715381 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-aa277930-1a20-4940-88c4-bc2eb65cc193 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.361544 Aug 10 11:23:10.717065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 44/88] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:10 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:10.847680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:10.849401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:10.858849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.859596 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.860859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.861766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:10.862460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:10.863158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:10.938358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.949582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.951365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:10.952677 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-62480327-4631-481c-a87a-b99f94848c33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.270192 Aug 10 11:23:10.953244 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 45/89] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:10 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:11.041958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:11.042585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:11.049797 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.050321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.050763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.051682 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.052301 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.052773 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.119763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:11.139854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6f97b069-7f7a-4186-a86b-aac64cf2bc4a tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.299179 Aug 10 11:23:11.144745 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 45/90] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:10 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:11.152567 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-9ad74b1d-00b9-4080-a832-42fa54348f2d req-cc0d209a-be2f-4104-8ba5-14a048b38d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6aeb94b-88c4-4f5c-844a-5fff3d2848dc", "tag": "a52cecc3-421d-4a63-a257-b873728af199"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:11.184021 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-9ad74b1d-00b9-4080-a832-42fa54348f2d req-cc0d209a-be2f-4104-8ba5-14a048b38d02 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.184741 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-9ad74b1d-00b9-4080-a832-42fa54348f2d req-cc0d209a-be2f-4104-8ba5-14a048b38d02 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.185802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-9ad74b1d-00b9-4080-a832-42fa54348f2d req-cc0d209a-be2f-4104-8ba5-14a048b38d02 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.200827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-9ad74b1d-00b9-4080-a832-42fa54348f2d req-cc0d209a-be2f-4104-8ba5-14a048b38d02 service nova] Creating event network-changed:a52cecc3-421d-4a63-a257-b873728af199 for instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc on hv-cinder-85061 Aug 10 11:23:11.207377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-9ad74b1d-00b9-4080-a832-42fa54348f2d req-cc0d209a-be2f-4104-8ba5-14a048b38d02 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060388 Aug 10 11:23:11.208587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 46/91] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:11.277254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:11.285090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e63fa07c-0515-476f-b12a-26d4e110db18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.247122 Aug 10 11:23:11.285664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 46/92] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:11 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:11.559362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-864bbeae-abd4-40ce-9e0f-0ea3aafd8eed req-5d881b4a-772a-455a-9c43-ae56f8c860e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd03df2-abc5-42f9-907e-ed5d88f1c45f", "name": "network-vif-plugged", "status": "completed", "tag": "f2971658-7d3d-409f-b328-e6511852a8bd"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:11.570446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-864bbeae-abd4-40ce-9e0f-0ea3aafd8eed req-5d881b4a-772a-455a-9c43-ae56f8c860e4 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.570945 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-864bbeae-abd4-40ce-9e0f-0ea3aafd8eed req-5d881b4a-772a-455a-9c43-ae56f8c860e4 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.571364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-864bbeae-abd4-40ce-9e0f-0ea3aafd8eed req-5d881b4a-772a-455a-9c43-ae56f8c860e4 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.583325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-864bbeae-abd4-40ce-9e0f-0ea3aafd8eed req-5d881b4a-772a-455a-9c43-ae56f8c860e4 service nova] Creating event network-vif-plugged:f2971658-7d3d-409f-b328-e6511852a8bd for instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f on hv-cinder-85061 Aug 10 11:23:11.589176 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-864bbeae-abd4-40ce-9e0f-0ea3aafd8eed req-5d881b4a-772a-455a-9c43-ae56f8c860e4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229419 Aug 10 11:23:11.589959 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 47/93] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:11.690372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:11.691527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:11.698192 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.698930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.699558 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.700281 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.700927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.701570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.738196 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:11.739000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:11.746839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.747333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.748429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.749320 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.749767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.750191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.925024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:11.932797 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1f46e9db-6aff-4cb2-a8a4-f67e9ac9e268 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.247945 Aug 10 11:23:11.933258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 47/94] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:11 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:11.962627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:11.971786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0048ce08-13ea-431f-a82b-9ef4c6709d33 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.237664 Aug 10 11:23:11.973033 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 48/95] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:11 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:11.977377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:11.978133 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:11.986012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.986599 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.987034 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:11.988869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:11.989455 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:11.989964 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.164612 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:12.165247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:12.173878 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:12.174992 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:12.175639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.176946 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:12.177610 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:12.178421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.301789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:12.310149 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:12.311824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:12.312971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b91ac82c-0e2d-4a49-8b7c-192f6695fdef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.339571 Aug 10 11:23:12.313540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 48/96] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:11 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:12.318225 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:12.318903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:12.326357 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:12.327304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:12.327935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.336224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:12.336224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:12.336224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.418936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=6 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:12.597096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:12.606983 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4280d820-f5c4-460d-ab26-17c91d89ec78 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.446878 Aug 10 11:23:12.608209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 49/97] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:12 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:12.685762 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:12.723558 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-92b90d3e-9ad1-4570-b15c-4b07a8e5ee47 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.408542 Aug 10 11:23:12.726881 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 49/98] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:12 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:12.955049 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:12.955697 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:12.957679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=36 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:12.962889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:12.963404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:12.963839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.964578 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:12.965034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:12.965460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:12.994623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:12.995488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:13.008757 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.009255 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.009690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.010390 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.010845 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.011265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.290961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.299147 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.303765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-45e20fd0-3777-47c8-8c89-b5ef9a00db1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.312834 Aug 10 11:23:13.314219 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 50/99] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:12 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:13.318030 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9289673e-a639-44fd-958b-332055febe9c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.367183 Aug 10 11:23:13.320179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-55fad3ec-f18e-4db4-8212-c2dce5a152e0 req-0ac71aab-15c5-4649-ab47-cae0e3caac40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf17719-c01d-4bcc-8a23-83d1a8a1a492", "tag": "4e6451ea-a107-42b4-9e4e-d34766a2f2d9"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:13.340536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 50/100] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:12 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:13.340623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-55fad3ec-f18e-4db4-8212-c2dce5a152e0 req-0ac71aab-15c5-4649-ab47-cae0e3caac40 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.340623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-55fad3ec-f18e-4db4-8212-c2dce5a152e0 req-0ac71aab-15c5-4649-ab47-cae0e3caac40 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.340623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-55fad3ec-f18e-4db4-8212-c2dce5a152e0 req-0ac71aab-15c5-4649-ab47-cae0e3caac40 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.340820 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:13.340820 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:13.361380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-55fad3ec-f18e-4db4-8212-c2dce5a152e0 req-0ac71aab-15c5-4649-ab47-cae0e3caac40 service nova] Creating event network-changed:4e6451ea-a107-42b4-9e4e-d34766a2f2d9 for instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 on hv-cinder-85061 Aug 10 11:23:13.363557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.367025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.369844 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.370731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.371238 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.373113 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.373207 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-55fad3ec-f18e-4db4-8212-c2dce5a152e0 req-0ac71aab-15c5-4649-ab47-cae0e3caac40 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055413 Aug 10 11:23:13.374109 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 51/101] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:13.496661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-d53636ee-d55f-4937-8817-1294d7c8315d req-28d38d16-e197-4566-9be3-97aea91960c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6e3975-83d1-4eed-944c-38567ce25a00", "tag": "e2afddf9-0581-4dda-930a-1bfbd2584827"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:13.506851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-d53636ee-d55f-4937-8817-1294d7c8315d req-28d38d16-e197-4566-9be3-97aea91960c8 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.507326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-d53636ee-d55f-4937-8817-1294d7c8315d req-28d38d16-e197-4566-9be3-97aea91960c8 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.507753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-d53636ee-d55f-4937-8817-1294d7c8315d req-28d38d16-e197-4566-9be3-97aea91960c8 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.519039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-d53636ee-d55f-4937-8817-1294d7c8315d req-28d38d16-e197-4566-9be3-97aea91960c8 service nova] Creating event network-changed:e2afddf9-0581-4dda-930a-1bfbd2584827 for instance ab6e3975-83d1-4eed-944c-38567ce25a00 on hv-cinder-85061 Aug 10 11:23:13.523704 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-d53636ee-d55f-4937-8817-1294d7c8315d req-28d38d16-e197-4566-9be3-97aea91960c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031367 Aug 10 11:23:13.524327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 52/102] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:23:13.570697 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.579818 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.581394 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.582523 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-54b9cfa9-cfd2-461d-9ebd-bcaa93af0e06 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.248786 Aug 10 11:23:13.583476 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 51/103] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:13 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:13.630110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:13.630932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:13.637253 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.637850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.640280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.641060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.641590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.642106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.746110 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:13.746437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:13.762135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.762635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.763069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.773669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:13.773669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:13.773669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:13.793317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=8 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:13.819860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.824929 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-296a2f90-88c2-4097-ae14-1e2020b1b3ea tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.198347 Aug 10 11:23:13.826374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 53/104] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:13 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:13.957691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:13.965345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-18352da9-2474-4a1d-b7c4-ac34807ba991 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.223250 Aug 10 11:23:13.965959 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 52/105] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:13 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:14.324793 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:14.325431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:14.334094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.334094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.334094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:14.334094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.334397 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.334489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:14.346355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:14.379634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:14.391886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.392325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.392759 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:14.394294 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.394739 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.395166 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:14.492939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=28 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:14.677795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:14.687696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-02bc4d20-458a-4085-8476-04dcc0b738cb tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.366962 Aug 10 11:23:14.688426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 54/106] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:14 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:14.699722 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:14.700368 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:14.718166 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.718669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.719103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:14.722564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.724496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.725196 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:14.788140 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:14.797974 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-69f595c9-8afb-457d-8241-3469daeefb9d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.456445 Aug 10 11:23:14.813821 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 53/107] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:14 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:14.847317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:14.848176 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:14.860950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.867794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.869947 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:14.873250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:14.875509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:14.876196 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.464575 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:15.486533 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:15.488359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:15.492945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9f78ba6f-965b-4c18-bf2c-dd30b2b10241 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.800154 Aug 10 11:23:15.493692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 55/108] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:14 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:15.505700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:15.506501 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:15.514692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:15.515254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:15.515862 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.517024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:15.517622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:15.518344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.537596 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:15.547879 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5d071248-a9ea-4918-b5cd-fb9bab8df263 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.703183 Aug 10 11:23:15.548733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 54/109] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:14 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:15.559093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-e8174f14-8180-4bbe-9be3-504ce000c5b2 req-5aff16e4-5b73-4b4f-8d4b-3f2a1cf8be2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efa0d4f-5ba3-4b0b-a331-ce5dab394d80", "name": "network-vif-plugged", "status": "completed", "tag": "9fb59bc9-c4a4-4e37-b37f-b173da2c56f4"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:15.573833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-e8174f14-8180-4bbe-9be3-504ce000c5b2 req-5aff16e4-5b73-4b4f-8d4b-3f2a1cf8be2c service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:15.574512 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-e8174f14-8180-4bbe-9be3-504ce000c5b2 req-5aff16e4-5b73-4b4f-8d4b-3f2a1cf8be2c service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:15.575122 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-e8174f14-8180-4bbe-9be3-504ce000c5b2 req-5aff16e4-5b73-4b4f-8d4b-3f2a1cf8be2c service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.580074 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:15.587328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-e8174f14-8180-4bbe-9be3-504ce000c5b2 req-5aff16e4-5b73-4b4f-8d4b-3f2a1cf8be2c service nova] Creating event network-vif-plugged:9fb59bc9-c4a4-4e37-b37f-b173da2c56f4 for instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 on hv-cinder-85061 Aug 10 11:23:15.594835 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-e8174f14-8180-4bbe-9be3-504ce000c5b2 req-5aff16e4-5b73-4b4f-8d4b-3f2a1cf8be2c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044125 Aug 10 11:23:15.596062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 55/110] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:15.720418 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:15.722418 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:15.729416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:15.730306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:15.730927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.732877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:15.733642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:15.734323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.755754 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:15.766648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-dbf40ef6-485a-4c03-9697-5f1c3136a42e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.264185 Aug 10 11:23:15.770838 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 56/111] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:15 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:15.821090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:15.822476 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:15.834279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:15.840586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:15.842732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.846488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:15.849165 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:15.851976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:15.862011 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:16.149402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:16.159031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a87d3e9d-5bdc-43b6-b296-6cc7ed5e3600 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.453880 Aug 10 11:23:16.170051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 56/112] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:15 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:16.190336 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:16.199858 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c0d51a03-63d6-483b-8c78-6b2d68ea2720 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.384215 Aug 10 11:23:16.200482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 57/113] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:15 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:16.518236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:16.519108 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:16.526395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:16.526979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:16.527483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:16.528304 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:16.529144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:16.529636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:16.582445 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:16.584096 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:16.607249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:16.608474 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:16.610811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:16.612828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:16.613505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:16.613946 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.019115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.027825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.029415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.030545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-79de0c6c-67de-4c98-8e44-d8cf98fa36d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.517331 Aug 10 11:23:17.031113 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 57/114] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:16 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:17.035881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:17.036577 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:17.043255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.043739 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.044198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.045625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.046112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.046562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.071071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.080444 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ec86e7b6-0f95-4935-badb-9b99db0c9dc2 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1314 microversion: 2.1 time: 0.504426 Aug 10 11:23:17.081465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 58/115] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:16 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1314 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:17.180772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:17.185480 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:17.187817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.188347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.188771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.189469 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.189929 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.190337 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.206124 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.214065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cd2febe7-9150-4a96-9acb-75838d4500b3 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.181943 Aug 10 11:23:17.214657 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 58/116] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:17 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:17.221897 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:17.222531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:17.228724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.229217 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.229656 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.230381 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.230925 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.231353 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.421818 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.430359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b65deb45-ba86-413b-bb7e-7f53d6c73898 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.253831 Aug 10 11:23:17.432260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 59/117] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:17 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:17.475772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:17.475772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-83b6330f-c1c4-4f95-9bfe-c6a082e862b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.253377 Aug 10 11:23:17.475772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 59/118] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:17 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:17.616555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-9997ed1a-8f8e-4a8d-83f6-11ac1d827fd7 req-d479dce0-a9fe-43a5-8a95-02873d5d4aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dee8fd-096f-489c-a67b-dee7491702ad", "name": "network-vif-plugged", "status": "completed", "tag": "fbf08147-0d64-437e-af90-de99285a3fd7"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:17.626977 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9997ed1a-8f8e-4a8d-83f6-11ac1d827fd7 req-d479dce0-a9fe-43a5-8a95-02873d5d4aaf service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:17.627447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9997ed1a-8f8e-4a8d-83f6-11ac1d827fd7 req-d479dce0-a9fe-43a5-8a95-02873d5d4aaf service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:17.627871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9997ed1a-8f8e-4a8d-83f6-11ac1d827fd7 req-d479dce0-a9fe-43a5-8a95-02873d5d4aaf service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:17.639341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-9997ed1a-8f8e-4a8d-83f6-11ac1d827fd7 req-d479dce0-a9fe-43a5-8a95-02873d5d4aaf service nova] Creating event network-vif-plugged:fbf08147-0d64-437e-af90-de99285a3fd7 for instance e1dee8fd-096f-489c-a67b-dee7491702ad on hv-cinder-85061 Aug 10 11:23:17.644395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-9997ed1a-8f8e-4a8d-83f6-11ac1d827fd7 req-d479dce0-a9fe-43a5-8a95-02873d5d4aaf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031459 Aug 10 11:23:17.644978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 60/119] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:18.053204 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:18.053740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:18.059707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.060430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.060688 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.061372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.061825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.062248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.102993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:18.103768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:18.112523 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.112808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.113237 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.113944 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.114431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.114831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.266288 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.282042 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.285390 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.286979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-df2cc52e-7d3d-4c96-ac72-b27ecff3ec19 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.237600 Aug 10 11:23:18.289849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 60/120] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:18 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:18.291155 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.307506 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2d828e4d-58ad-4b55-b3c2-065ea8345183 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1500 microversion: 2.1 time: 0.201018 Aug 10 11:23:18.307506 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 61/121] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:18 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1500 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:18.311263 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:18.312132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:18.319835 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.331133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.331133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.331133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.331133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.331383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.457169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:18.457783 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:18.472492 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.473006 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.473446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.474255 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.474715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.475203 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.528341 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.539432 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b9dadb91-c260-4dc8-a581-a452e71c393d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.248338 Aug 10 11:23:18.540443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 61/122] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:18 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:18.546483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:18.547089 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:18.553421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.557679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.557679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.557679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:18.557679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:18.558515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:18.719858 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.728724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ac99fb00-1d81-4f78-9284-96c904e50f76 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.275410 Aug 10 11:23:18.741493 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 62/123] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:18 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:18.753447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:18.760928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-501e0041-fe2c-4210-8cb2-dbe116cbe32e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.218917 Aug 10 11:23:18.761478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 62/124] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:18 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:19.315303 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:19.316497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:19.327524 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.327524 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.327524 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.327524 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.327880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.327880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.485193 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:19.493685 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:19.495434 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:19.496700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-34f526ce-3636-4595-8dac-dfac4c31ff77 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.185470 Aug 10 11:23:19.497263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 63/125] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:19 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:19.564652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:19.565272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:19.567197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:19.571862 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.572457 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.572891 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.573935 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.574519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.575041 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.750722 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:19.751388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:19.774770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.775317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.779484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.781108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.781639 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.782139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.891811 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:19.908480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e232807f-c17c-4a64-b0db-d446f7a401f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.347896 Aug 10 11:23:19.910321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 63/126] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:19 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:19.917094 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:19.920679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:19.930505 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.932473 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.935444 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.936885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:19.937755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:19.938361 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:19.988435 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:19.996796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-11d38175-2ff4-4756-aa8f-f39999428c72 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.250005 Aug 10 11:23:19.997406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 64/127] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:19 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:20.135470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:20.144724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e3b6c0a3-f3f2-433f-897f-72d45dc3ffbb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.231416 Aug 10 11:23:20.145583 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 64/128] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:19 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:20.524883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:20.525486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:20.532272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:20.532749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:20.533179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:20.533871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:20.534328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:20.534756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:20.670293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:20.687979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:20.689489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:20.691700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-04e33eea-50fa-4361-ac48-ec752ae17d14 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.170681 Aug 10 11:23:20.692834 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 65/129] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:20 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:20.937915 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:20.948981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:20.953421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:20.953921 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:20.958575 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:20.959555 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:20.960115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:20.960737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.019041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:21.019856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:21.025825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:21.026306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:21.026737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.027416 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:21.028039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:21.028457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.162089 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.174842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2b388dff-5ddd-4f7a-bc6d-db9fa752dfc4 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.242085 Aug 10 11:23:21.176273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 65/130] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:20 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:21.185545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:21.187287 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:21.200578 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:21.202197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:21.202878 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.204077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:21.204735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:21.205357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.259183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.278081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-213693f8-5b80-4407-9338-b97a0419026d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.261169 Aug 10 11:23:21.278802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 66/131] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:21 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:21.362209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.370751 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3365ee8a-0685-4cdd-b00d-c07148ba4ce7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.192471 Aug 10 11:23:21.371665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 66/132] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:21 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:21.390230 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a10a119-9cb3-49bb-9d70-8aad737ffc09"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:21.392649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:21.398586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:21.399067 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:21.399566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.400290 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:21.400736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:21.401153 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.717949 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:21.718542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:21.724466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:21.724938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:21.725362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.726127 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:21.726473 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:21.726890 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:21.859827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.867931 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.869453 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:21.870590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6611f363-c0cf-4e01-acad-2ec7b2aece88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.157738 Aug 10 11:23:21.871364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 67/133] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:21 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:22.197035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:22.204403 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:22.206101 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.206945 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.207347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.208142 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.208806 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.209285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.362355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:22.370348 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ff3cd2f0-fb41-4d82-a91c-0679c2cccd90 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.177650 Aug 10 11:23:22.370917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 68/134] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:22 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:22.379658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:22.380362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:22.386714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.387190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.387613 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.389584 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.390416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.390985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.539823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:22.547913 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c2c39bf1-b76d-48b9-99a6-9381a26cc6c5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.176004 Aug 10 11:23:22.548509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 69/135] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:22 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:22.553063 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:22.553357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:22.558780 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.559253 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.559672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.561446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.561892 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.562308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.708135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:22.710832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-82fb4801-760a-4d24-b10a-c9eb990c08da tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.161329 Aug 10 11:23:22.711330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 70/136] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:22 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:22.895314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:22.896211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:22.903431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.904632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.904993 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:22.905789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:22.906386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:22.907037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.055559 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:23.076979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:23.080090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:23.081544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5c6257d1-59b3-450c-aea9-042e96326dce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.192495 Aug 10 11:23:23.082769 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 71/137] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:22 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:23.391805 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:23.393096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:23.406332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.406332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.406332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.406332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.406680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.407083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.436133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:23.565941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:23.574437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5e40d046-54cf-4596-b923-38fcb56a69b5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.187393 Aug 10 11:23:23.580441 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 72/138] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:23 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:23.597137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:23.597137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:23.609483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.610184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.610776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.611690 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.612360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.612990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.794960 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:23.802500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e0dfd670-be7b-4ea3-83b5-9bd4ebdc77a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.220948 Aug 10 11:23:23.803081 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 73/139] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:23 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:23.808498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-4ba58bbe-3f08-4ef3-8506-d819364dc756 req-33717c0a-2f4c-42b9-ac28-ca01d90828f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf17719-c01d-4bcc-8a23-83d1a8a1a492", "name": "network-vif-plugged", "status": "completed", "tag": "4e6451ea-a107-42b4-9e4e-d34766a2f2d9"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:23.823822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-4ba58bbe-3f08-4ef3-8506-d819364dc756 req-33717c0a-2f4c-42b9-ac28-ca01d90828f4 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.824365 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-4ba58bbe-3f08-4ef3-8506-d819364dc756 req-33717c0a-2f4c-42b9-ac28-ca01d90828f4 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.824795 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-4ba58bbe-3f08-4ef3-8506-d819364dc756 req-33717c0a-2f4c-42b9-ac28-ca01d90828f4 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.837812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-4ba58bbe-3f08-4ef3-8506-d819364dc756 req-33717c0a-2f4c-42b9-ac28-ca01d90828f4 service nova] Creating event network-vif-plugged:4e6451ea-a107-42b4-9e4e-d34766a2f2d9 for instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 on hv-cinder-85061 Aug 10 11:23:23.843288 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-4ba58bbe-3f08-4ef3-8506-d819364dc756 req-33717c0a-2f4c-42b9-ac28-ca01d90828f4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038724 Aug 10 11:23:23.844088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 74/140] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:23.849085 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:23.849767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:23.856381 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.857681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.858119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:23.858894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:23.859346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:23.859764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.006308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.014899 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b38fa198-6c66-4ff2-86ca-ab0f05060189 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.169508 Aug 10 11:23:24.019227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 75/141] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:23 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:24.105573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:24.106177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:24.112724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.113209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.113640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.125740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.126254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.126942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.287802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.296574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.298074 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.299291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ac13cb2c-2de4-4d32-a0de-168b161a50f7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.197805 Aug 10 11:23:24.299852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 76/142] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:24 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:24.597923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:24.598536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:24.604656 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.605147 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.605582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.606265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.606841 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.607370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.759119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.767465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0beaa5d8-4344-45ca-ab16-d1fc66d1e603 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.173784 Aug 10 11:23:24.768054 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 77/143] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:24 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:24.824311 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:24.824909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:24.832149 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.832629 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.833091 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.833771 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:24.834347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:24.836873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:24.988254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:24.996408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1ca3e0d8-7f7e-4416-8ebc-f2b78ec19003 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.176054 Aug 10 11:23:25.004681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 78/144] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:24 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:25.035634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:25.036415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:25.042459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.042946 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.043378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.049048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.049048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.049048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.225592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:25.239384 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8cd065fe-b2d6-46b5-b5b3-7f72c9f2514e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.208018 Aug 10 11:23:25.240310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 79/145] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:25 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:25.321850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:25.323090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:25.329698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.330175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.330602 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.331281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.331724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.332168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.696650 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:25.705408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:25.707012 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:25.708258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6ca6f28f-a3b5-4af0-bf22-cff50a4201b9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.390249 Aug 10 11:23:25.713764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 80/146] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:25 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:25.788656 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:25.789292 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:25.796442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.796934 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.797493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.798295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:25.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:25.799170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:25.992958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:26.003536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b5f066d2-9dc1-4b75-85d6-5534ee16932f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.218703 Aug 10 11:23:26.004778 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 81/147] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:25 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:26.027135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:26.027933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:26.034154 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:26.034703 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:26.035084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:26.035810 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:26.036290 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:26.036714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:26.174949 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:26.182426 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-29b490c6-6622-4912-a8bd-53201879407e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.159419 Aug 10 11:23:26.182979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 82/148] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:26 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:26.260863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:26.261462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:26.268615 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:26.269184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:26.269684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:26.270435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:26.270948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:26.271434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:26.521591 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:26.528993 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3f384d40-179b-4d95-8523-af2457157c7d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.271908 Aug 10 11:23:26.529755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 83/149] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:26 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:26.730709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:26.731303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:26.737824 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:26.738299 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:26.738755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:26.739428 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:26.739871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:26.740306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:26.886277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:26.896666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:26.898173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:26.899266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b4b46b1c-2c33-4fea-8395-5a879de65032 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.172540 Aug 10 11:23:26.900035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 84/150] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:26 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:23:27.027918 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:27.029233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:27.035424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.035899 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.036354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.037030 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.037470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.037882 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.195401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:27.208605 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0a2bb8aa-c852-415e-b04e-05a026702a91 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.184529 Aug 10 11:23:27.209726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 85/151] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:27 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:27.215475 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:27.217251 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:27.228704 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.229631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.230153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.232195 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.232877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.233511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.330355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9f640ada-5bda-458e-be22-f68038b8f75b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "POST /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.954423 Aug 10 11:23:27.332080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 67/152] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:23:21 2022] POST /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f/os-volume_attachments => generated 194 bytes in 5957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:27.395872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:27.405834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c52f179e-163d-482f-8213-bc67345a59dc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.194619 Aug 10 11:23:27.406566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 86/153] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:27 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:27.550910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:27.551608 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:27.565768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.566265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.566700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.567413 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.567855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.568300 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.694885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-7bb9346b-5634-4c34-aea4-86575e4128f8 req-8bb5c802-ad07-42bd-9428-6969670171ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6aeb94b-88c4-4f5c-844a-5fff3d2848dc", "name": "network-vif-plugged", "status": "completed", "tag": "a52cecc3-421d-4a63-a257-b873728af199"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:27.707871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7bb9346b-5634-4c34-aea4-86575e4128f8 req-8bb5c802-ad07-42bd-9428-6969670171ec service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.708393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7bb9346b-5634-4c34-aea4-86575e4128f8 req-8bb5c802-ad07-42bd-9428-6969670171ec service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.708813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7bb9346b-5634-4c34-aea4-86575e4128f8 req-8bb5c802-ad07-42bd-9428-6969670171ec service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.743128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-7bb9346b-5634-4c34-aea4-86575e4128f8 req-8bb5c802-ad07-42bd-9428-6969670171ec service nova] Creating event network-vif-plugged:a52cecc3-421d-4a63-a257-b873728af199 for instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc on hv-cinder-85061 Aug 10 11:23:27.753128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-7bb9346b-5634-4c34-aea4-86575e4128f8 req-8bb5c802-ad07-42bd-9428-6969670171ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064970 Aug 10 11:23:27.755703 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 87/154] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:23:27.763800 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:27.773510 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-399cd7a0-3070-4b41-be9a-5193f578199c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.227015 Aug 10 11:23:27.774472 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 68/155] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:27 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:27.923828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:27.924538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:27.930681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.931642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.934857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:27.934857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:27.934857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:27.934857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.072823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.081921 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.083547 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.084677 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9a43b8c6-01b9-422d-b625-172a3155c7f3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.165835 Aug 10 11:23:28.085221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 88/156] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:27 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:28.230141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:28.230663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:28.236890 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.237370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.237855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.238539 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.238988 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.239422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.391042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.400243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9195088c-4aa3-4b03-9d9a-a80d987d620e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.173973 Aug 10 11:23:28.401426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 69/157] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:28 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:28.426493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:28.427096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:28.433553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.434041 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.434623 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.435927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.436560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.436979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.698267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.698267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-669ca668-3b33-4a7e-98ed-dd10db643a79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.189092 Aug 10 11:23:28.698267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 89/158] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:28 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:28.827016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:28.827016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:28.827016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.827016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.827473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.827473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:28.827473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:28.827473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:28.937423 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:28.944856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2cb1ab18-8a14-4380-96f0-5c650727632e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1322 microversion: 2.1 time: 0.154773 Aug 10 11:23:28.945410 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 70/159] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:28 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:29.108048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:29.108719 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:29.115066 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.115980 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.116666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.117722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.118355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.118926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.135125 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:29.263973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:29.271786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:29.273357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:29.274464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f10d8c83-a5e1-4cb6-a6b0-8f75d8126fd8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1407 microversion: 2.20 time: 0.171483 Aug 10 11:23:29.275021 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 90/160] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:29 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:29.422335 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:29.422891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:29.428996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.437347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.437347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.437347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.437347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.437749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.598438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:29.608679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3d589845-4f1c-4c7d-b6c0-8bba13cc7012 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.191380 Aug 10 11:23:29.609199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 71/161] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:29 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:29.721141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:29.721141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:29.737374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.738055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.738607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.739410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:29.739965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:29.748422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:29.916411 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:29.922061 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-257a95c8-3a28-43b2-a7c2-a5edc1f4cc6f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.207687 Aug 10 11:23:29.922809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 91/162] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:29 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:29.991976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:29.992676 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:30.003815 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.007475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.008172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.011759 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.012540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.013843 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.098402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-930105b4-4859-4471-8a73-4cacbd97f1c0 req-97572a5c-1e85-4ea3-b8ad-3d459edf7007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6e3975-83d1-4eed-944c-38567ce25a00", "name": "network-vif-plugged", "status": "completed", "tag": "e2afddf9-0581-4dda-930a-1bfbd2584827"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:30.112103 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-930105b4-4859-4471-8a73-4cacbd97f1c0 req-97572a5c-1e85-4ea3-b8ad-3d459edf7007 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.113202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-930105b4-4859-4471-8a73-4cacbd97f1c0 req-97572a5c-1e85-4ea3-b8ad-3d459edf7007 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.113649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-930105b4-4859-4471-8a73-4cacbd97f1c0 req-97572a5c-1e85-4ea3-b8ad-3d459edf7007 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.127099 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-930105b4-4859-4471-8a73-4cacbd97f1c0 req-97572a5c-1e85-4ea3-b8ad-3d459edf7007 service nova] Creating event network-vif-plugged:e2afddf9-0581-4dda-930a-1bfbd2584827 for instance ab6e3975-83d1-4eed-944c-38567ce25a00 on hv-cinder-85061 Aug 10 11:23:30.131943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-930105b4-4859-4471-8a73-4cacbd97f1c0 req-97572a5c-1e85-4ea3-b8ad-3d459edf7007 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042723 Aug 10 11:23:30.132513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 92/163] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:23:30.265216 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:30.274057 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3b405b38-c9fd-4832-be32-4cca1fd307e0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1517 microversion: 2.1 time: 0.287042 Aug 10 11:23:30.274636 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 72/164] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:29 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1517 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:30.299822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:30.300860 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:30.303911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:30.306262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:30.309073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.310241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.311519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.313416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.314064 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.314859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.314967 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.315580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.316266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.319544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.319544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.319544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.323821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:30.349242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lazy-loading 'flavor' on Instance uuid e1dee8fd-096f-489c-a67b-dee7491702ad {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:23:30.486743 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:30.489330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:30.491008 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:30.492294 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5aaf6fac-60d3-47e8-b667-3fe3ff753dae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1598 microversion: 2.20 time: 0.199316 Aug 10 11:23:30.493027 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 93/165] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:23:30 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1598 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:23:30.522311 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:30.523071 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:30.529975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.530828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.531364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.532180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.532848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.533337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.755344 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8700d0ce-125f-4951-9b84-c4f27769b7f5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.238408 Aug 10 11:23:30.757202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 94/166] 10.222.0.13 () {60 vars in 1316 bytes} [Wed Aug 10 11:23:30 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:23:30.761437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:30.762031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:30.770530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.771037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.776285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.781062 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-963ab2fc-927d-4786-ad74-1a51812d2049 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad/action" status: 200 len: 32 microversion: 2.1 time: 0.482583 Aug 10 11:23:30.782508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 73/167] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:23:30 2022] POST /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad/action => generated 32 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:23:30.783842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.788688 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.789364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.795488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:30.797365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:30.816367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.818926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.819397 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:30.821165 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:30.822367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:30.822959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:31.324046 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:31.340687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:31.348338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-587a1c2f-3bba-418e-bf19-d5a7c9b73f4d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.559086 Aug 10 11:23:31.348922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 74/168] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:30 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:31.352079 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-483cb86a-6732-4232-b8a8-f51bc876d8f0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.594265 Aug 10 11:23:31.355898 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:31.356578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:31.365956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 95/169] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:30 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:31.376184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:31.376857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:31.377659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:31.378537 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:31.379066 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:31.379398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.035965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:32.039306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-869044ee-7ee6-4374-a198-6e1b95a7818b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.689131 Aug 10 11:23:32.040655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 75/170] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:31 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:32.391859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:32.392502 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:32.395765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:32.396994 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:32.407414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.407896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.410597 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.411086 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.411513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.412247 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.412690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.413100 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.414848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.415607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.416084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.416548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.724281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:32.734325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a3b3d652-e237-4be2-8ecb-a6f199c51ddf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.357157 Aug 10 11:23:32.734836 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:32.735865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 96/171] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:32 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:32.758573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-30763a2c-0137-4993-a5dd-e12550911deb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.377804 Aug 10 11:23:32.759186 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 76/172] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:32 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:32.902833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-2118cc93-c4d2-4113-8072-fcac88a40cb8 req-8c206005-d0d5-4855-9e7f-04e456635f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf17719-c01d-4bcc-8a23-83d1a8a1a492", "tag": "4e6451ea-a107-42b4-9e4e-d34766a2f2d9"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:32.913333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-2118cc93-c4d2-4113-8072-fcac88a40cb8 req-8c206005-d0d5-4855-9e7f-04e456635f35 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:32.914203 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-2118cc93-c4d2-4113-8072-fcac88a40cb8 req-8c206005-d0d5-4855-9e7f-04e456635f35 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:32.914426 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-2118cc93-c4d2-4113-8072-fcac88a40cb8 req-8c206005-d0d5-4855-9e7f-04e456635f35 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:32.928088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-2118cc93-c4d2-4113-8072-fcac88a40cb8 req-8c206005-d0d5-4855-9e7f-04e456635f35 service nova] Creating event network-changed:4e6451ea-a107-42b4-9e4e-d34766a2f2d9 for instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 on hv-cinder-85061 Aug 10 11:23:32.933015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-2118cc93-c4d2-4113-8072-fcac88a40cb8 req-8c206005-d0d5-4855-9e7f-04e456635f35 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033740 Aug 10 11:23:32.933613 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 97/173] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:33.062322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:33.063158 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:33.071151 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:33.071493 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:33.072024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:33.073180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:33.074121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:33.074729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:33.227724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:33.236652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d9b06e76-a3da-4203-a04e-ca7cab5be15b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1368 microversion: 2.1 time: 0.179397 Aug 10 11:23:33.237521 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 77/174] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:33 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:33.757296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:33.758014 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:33.765587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:33.766078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:33.766514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:33.767213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:33.767665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:33.768118 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:33.784379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:33.793278 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:33.793278 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:33.793278 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:33.793278 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:33.793688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:33.794287 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:33.794721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.016788 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:34.020504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:34.027128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1405104a-d511-47c8-afb5-cd1bf48adf71 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.273743 Aug 10 11:23:34.030208 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 98/175] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:33 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:34.045893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-67af08c5-f517-4086-9ee8-95897e2525ab tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1363 microversion: 2.1 time: 0.270755 Aug 10 11:23:34.046724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 78/176] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:33 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:34.260409 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:34.261490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:34.278569 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:34.279069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:34.279510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.280255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:34.280744 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:34.281189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.471475 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:34.479293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3ab89b55-3f22-4348-935f-a79e26ca0b58 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1558 microversion: 2.1 time: 0.225540 Aug 10 11:23:34.479930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 99/177] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:34 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:34.500662 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:34.501199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:34.507819 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:34.508265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:34.508701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.509428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:34.509895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:34.510321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:34.608899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-65f06729-7e19-42e2-9fc5-02b5684e46a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111916 Aug 10 11:23:34.609424 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 79/178] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 10 11:23:34 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:35.051071 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:35.052233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:35.067649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:35.068280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:35.074413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.077896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.079070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.079808 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.080323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.080747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.081949 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.083013 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.085262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.086258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.086835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.087584 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.343272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:35.351078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fefab9e6-ed14-4d95-8069-c366632cfe5d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.304264 Aug 10 11:23:35.351894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 100/179] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:35 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:35.375148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:35.378752 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-14a89d37-ea55-4be9-be56-21a3e371f888 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1549 microversion: 2.1 time: 0.315632 Aug 10 11:23:35.379525 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 80/180] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:35 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:35.406244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:35.406977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:35.416877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.417538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.418177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.419509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:35.420115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:35.420559 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:35.536817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6f3d7f49-afaa-471b-97fd-32dd4e9c0c01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134979 Aug 10 11:23:35.537868 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 101/181] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 10 11:23:35 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:36.380739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:36.381947 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:36.390797 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:36.391597 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:36.392212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:36.393198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:36.394116 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:36.394817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:36.465223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-ba39e484-1554-4358-8b07-c9027a1ac977 req-d056159d-2549-4105-8d8a-46f24177748f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6e3975-83d1-4eed-944c-38567ce25a00", "tag": "e2afddf9-0581-4dda-930a-1bfbd2584827"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:36.475174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ba39e484-1554-4358-8b07-c9027a1ac977 req-d056159d-2549-4105-8d8a-46f24177748f service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:36.475927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ba39e484-1554-4358-8b07-c9027a1ac977 req-d056159d-2549-4105-8d8a-46f24177748f service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:36.476554 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ba39e484-1554-4358-8b07-c9027a1ac977 req-d056159d-2549-4105-8d8a-46f24177748f service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:36.494177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-ba39e484-1554-4358-8b07-c9027a1ac977 req-d056159d-2549-4105-8d8a-46f24177748f service nova] Creating event network-changed:e2afddf9-0581-4dda-930a-1bfbd2584827 for instance ab6e3975-83d1-4eed-944c-38567ce25a00 on hv-cinder-85061 Aug 10 11:23:36.515757 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-ba39e484-1554-4358-8b07-c9027a1ac977 req-d056159d-2549-4105-8d8a-46f24177748f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057499 Aug 10 11:23:36.517109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 102/182] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:36.705562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:36.718169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f751591d-f4f6-4166-a0bb-3a0a2bc5a7bf tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.344199 Aug 10 11:23:36.719544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 81/183] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:36 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:37.188585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-f4b20466-16f1-4ad3-94c2-5847cb1f2c1a req-c78e877f-5647-4afe-9348-5bb1ca797e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6aeb94b-88c4-4f5c-844a-5fff3d2848dc", "tag": "a52cecc3-421d-4a63-a257-b873728af199"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:37.211320 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f4b20466-16f1-4ad3-94c2-5847cb1f2c1a req-c78e877f-5647-4afe-9348-5bb1ca797e12 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:37.212092 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f4b20466-16f1-4ad3-94c2-5847cb1f2c1a req-c78e877f-5647-4afe-9348-5bb1ca797e12 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:37.212752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f4b20466-16f1-4ad3-94c2-5847cb1f2c1a req-c78e877f-5647-4afe-9348-5bb1ca797e12 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:37.228365 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-f4b20466-16f1-4ad3-94c2-5847cb1f2c1a req-c78e877f-5647-4afe-9348-5bb1ca797e12 service nova] Creating event network-changed:a52cecc3-421d-4a63-a257-b873728af199 for instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc on hv-cinder-85061 Aug 10 11:23:37.233834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-f4b20466-16f1-4ad3-94c2-5847cb1f2c1a req-c78e877f-5647-4afe-9348-5bb1ca797e12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056692 Aug 10 11:23:37.234980 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 103/184] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:37.744934 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:37.746282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:37.754453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:37.755289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:37.755961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:37.756935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:37.757734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:37.758435 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:38.214412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:38.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a075d39c-1399-463a-84ed-cd923e962cd6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.486637 Aug 10 11:23:38.228816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 82/185] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:37 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:39.250589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:39.251958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:39.265468 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:39.267370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:39.268515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:39.269285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:39.269752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:39.270175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:39.517156 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:39.517791 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:39.533561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:39.539256 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=93 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:39.540762 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:39.546890 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:39.547374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:39.550002 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-24164b82-0ddc-4dcf-8622-53b25e23a978 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.304301 Aug 10 11:23:39.550308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:39.550823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:39.551267 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:39.553419 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 104/186] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:39 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:39.591886 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:23:40.077873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b2b73455-4d8f-460d-a8a7-ae0103013f56 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 204 len: 0 microversion: 2.1 time: 0.564536 Aug 10 11:23:40.078573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 83/187] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:23:39 2022] DELETE /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:23:40.088235 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:40.088839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:40.096119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:40.096884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:40.099025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:40.099744 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:40.100231 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:40.100652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:40.242499 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:40.251728 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5aa9b8e0-3f26-4e74-9951-c31d1035714e tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1552 microversion: 2.1 time: 0.168214 Aug 10 11:23:40.252650 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 105/188] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:40 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1552 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:40.576178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:40.577522 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:40.587280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:40.588111 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:40.588699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:40.589613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:40.591377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:40.591891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:40.772474 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:40.781148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fd6561ed-63dd-4374-993d-2cd3aaff585c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.209972 Aug 10 11:23:40.782121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 84/189] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:40 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:41.273525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:41.274053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:41.280393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:41.280865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:41.281292 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:41.281962 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:41.282401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:41.282813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:41.414105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:41.423173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3bd74a88-eb8d-4204-a461-6bc879dc9689 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1552 microversion: 2.1 time: 0.153465 Aug 10 11:23:41.423817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 106/190] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:41 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:41.802461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:41.803707 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:41.811185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:41.811693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:41.812235 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:41.812932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:41.813383 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:41.813809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:41.946005 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:41.954547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9362ad56-b312-4282-a9ed-a6fa60172dcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.155980 Aug 10 11:23:41.955106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 85/191] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:41 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:42.445811 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:42.446513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:42.453387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:42.453866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:42.454295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:42.455006 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:42.455453 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:42.455876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:42.596174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:42.604383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-491d13d5-2de7-4654-a1bd-1b4601bc8d3c tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1552 microversion: 2.1 time: 0.162272 Aug 10 11:23:42.604920 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 107/192] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:42 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:42.976259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:42.977035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:42.985627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:42.986665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:42.987781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:42.988671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:42.989337 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:42.990029 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:43.006668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:43.126581 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:43.134099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e9914c0f-c376-40f6-9090-0c2b1567b3e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.161957 Aug 10 11:23:43.134667 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 86/193] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:42 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:43.626438 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:43.627044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:43.633029 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:43.633509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:43.633939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:43.634726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:43.635107 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:43.635526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:43.772184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:43.780871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8dee0c75-b2bb-4117-9927-3c3d9eac8bca tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1552 microversion: 2.1 time: 0.158700 Aug 10 11:23:43.781468 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 108/194] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:43 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:44.157135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:44.157807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:44.166174 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:44.166661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:44.167097 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:44.167795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:44.168267 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:44.168691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:44.311291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:44.318621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c63d0fda-398a-4efe-bc1d-bc5df865d404 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.165906 Aug 10 11:23:44.319178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 87/195] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:44 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:44.755577 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-f4855eaf-86fb-4783-a88a-9789152d0354 req-8f171bd6-4191-4a50-88f1-8f55e1f864ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd03df2-abc5-42f9-907e-ed5d88f1c45f", "name": "network-vif-deleted", "tag": "f2971658-7d3d-409f-b328-e6511852a8bd"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:44.769365 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f4855eaf-86fb-4783-a88a-9789152d0354 req-8f171bd6-4191-4a50-88f1-8f55e1f864ab service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:44.769365 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f4855eaf-86fb-4783-a88a-9789152d0354 req-8f171bd6-4191-4a50-88f1-8f55e1f864ab service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:44.769365 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f4855eaf-86fb-4783-a88a-9789152d0354 req-8f171bd6-4191-4a50-88f1-8f55e1f864ab service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:44.778276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-f4855eaf-86fb-4783-a88a-9789152d0354 req-8f171bd6-4191-4a50-88f1-8f55e1f864ab service nova] Creating event network-vif-deleted:f2971658-7d3d-409f-b328-e6511852a8bd for instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f on hv-cinder-85061 Aug 10 11:23:44.784268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-f4855eaf-86fb-4783-a88a-9789152d0354 req-8f171bd6-4191-4a50-88f1-8f55e1f864ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032431 Aug 10 11:23:44.784877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 109/196] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:23:44.802157 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:44.802771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:44.809341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:44.810524 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:44.811259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:44.811963 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:44.812562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:44.813062 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:44.880320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:44.891973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6c1b239d-5de1-4cfb-9168-d6adb80e5ba0 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1510 microversion: 2.1 time: 0.094019 Aug 10 11:23:44.905775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 88/197] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:44 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1510 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:45.340756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:45.341582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:45.348449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:45.348968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:45.349361 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:45.350106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:45.350562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:45.350979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:45.494873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:45.503044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7e296b93-576c-4f67-90d7-5afc0418fd3b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.166429 Aug 10 11:23:45.506738 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 110/198] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:45 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:45.913387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:45.914012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:45.921728 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:45.922206 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:45.922632 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:45.923304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:45.924063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:45.924521 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:45.957401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:45.958012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:45.958450 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:45.958893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lazy-loading 'fault' on Instance uuid 7dd03df2-abc5-42f9-907e-ed5d88f1c45f {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:23:46.008241 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2386a816917a4c3d97f394b07d901386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac78c80460af43e0aa28dc607af188d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:46.025073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f5a48e5e-6f6e-4b9a-817d-4264ef22f25b tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 200 len: 1350 microversion: 2.1 time: 0.115409 Aug 10 11:23:46.025658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 89/199] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:45 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 1350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:46.524300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:46.527855 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:46.534370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:46.534859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:46.535289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:46.537494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:46.537494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:46.537494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:46.540861 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:46.675415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:46.683095 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9d700dcb-c101-4dd6-9357-656e849ac55b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.162706 Aug 10 11:23:46.683714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 111/200] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:46 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:47.047613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:47.048254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:47.054602 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:47.055020 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:47.055457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:47.056486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:47.056956 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:47.057372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:47.072447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] HTTP exception thrown: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Request method failure captured: Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f HTTP/1.1 Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85T6nzQ1LT8-3-9z1hV8EFPxOO5-knRVclutrFKksyXsEfYRku00GEJVYlFoNRuiJDut09IbkEJ6ZHmTT2z-oCt4j4P-OtHAW0x13pc94mwAhSni9alZaL1p-EGBLbqYD4ERqbq5TacpMH36R0kck2dWNWBavL6wf9eXV-Aj7AjQpGs Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: ac78c80460af43e0aa28dc607af188d5 Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:23:47.077825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: ac78c80460af43e0aa28dc607af188d5 Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-DeleteServersTestJSON-42660846-project Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 2386a816917a4c3d97f394b07d901386 Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-DeleteServersTestJSON-42660846-project Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.079262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '7dd03df2-abc5-42f9-907e-ed5d88f1c45f'} Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:47.080202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.081589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.082840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Returning 404 to user: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:47.082840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c4a32988-50b4-452f-92e9-ccd1e5341284 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 404 len: 111 microversion: 2.1 time: 0.036481 Aug 10 11:23:47.082840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 90/201] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:47 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:47.196183 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:47.198362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:47.205486 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:47.206004 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:47.206474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:47.207225 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:47.207716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:47.208165 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:47.221485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] HTTP exception thrown: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Request method failure captured: Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f/os-volume_attachments HTTP/1.1 Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85T6nzQ1LT8-3-9z1hV8EFPxOO5-knRVclutrFKksyXsEfYRku00GEJVYlFoNRuiJDut09IbkEJ6ZHmTT2z-oCt4j4P-OtHAW0x13pc94mwAhSni9alZaL1p-EGBLbqYD4ERqbq5TacpMH36R0kck2dWNWBavL6wf9eXV-Aj7AjQpGs Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: ac78c80460af43e0aa28dc607af188d5 Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:23:47.226051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: ac78c80460af43e0aa28dc607af188d5 Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-DeleteServersTestJSON-42660846-project Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 2386a816917a4c3d97f394b07d901386 Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-DeleteServersTestJSON-42660846-project Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.227249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'server_id': '7dd03df2-abc5-42f9-907e-ed5d88f1c45f'} Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:47.227930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:47.228972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:47.229998 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Returning 404 to user: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:47.229998 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cef9e69b-d389-46a7-b315-ec5054fb0b20 tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036105 Aug 10 11:23:47.229998 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 112/202] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:23:47 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:23:47.707802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:47.707802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:47.712227 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:47.712739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:47.713314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:47.714005 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:47.714530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:47.715040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:47.864350 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:47.874038 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-584733f1-a3fc-437c-a7a3-ecd5374a1c5c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.170573 Aug 10 11:23:47.874183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 91/203] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:47 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:48.739833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:48.741065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:48.743361 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:23:48.749045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:48.749539 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:48.750136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:48.758544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:48.758544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:48.758858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:48.777232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] HTTP exception thrown: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Request method failure captured: Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: DELETE /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f HTTP/1.1 Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85T6nzQ1LT8-3-9z1hV8EFPxOO5-knRVclutrFKksyXsEfYRku00GEJVYlFoNRuiJDut09IbkEJ6ZHmTT2z-oCt4j4P-OtHAW0x13pc94mwAhSni9alZaL1p-EGBLbqYD4ERqbq5TacpMH36R0kck2dWNWBavL6wf9eXV-Aj7AjQpGs Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: ac78c80460af43e0aa28dc607af188d5 Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:23:48.780121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: ac78c80460af43e0aa28dc607af188d5 Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-DeleteServersTestJSON-42660846-project Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 2386a816917a4c3d97f394b07d901386 Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-DeleteServersTestJSON-42660846-project Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.781414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '7dd03df2-abc5-42f9-907e-ed5d88f1c45f'} Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:48.782236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.783680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.785077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Returning 404 to user: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:48.785077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5ef9beb3-bfa6-425d-8c58-27ae6de590fc tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 404 len: 111 microversion: 2.1 time: 0.046070 Aug 10 11:23:48.785077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 113/204] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:23:48 2022] DELETE /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:48.790346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:48.790982 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] [instance: 7dd03df2-abc5-42f9-907e-ed5d88f1c45f] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:48.799778 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:48.800296 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:48.800731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:48.801421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:48.801874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:48.802294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:48.817472 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] HTTP exception thrown: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Request method failure captured: Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f HTTP/1.1 Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85T6nzQ1LT8-3-9z1hV8EFPxOO5-knRVclutrFKksyXsEfYRku00GEJVYlFoNRuiJDut09IbkEJ6ZHmTT2z-oCt4j4P-OtHAW0x13pc94mwAhSni9alZaL1p-EGBLbqYD4ERqbq5TacpMH36R0kck2dWNWBavL6wf9eXV-Aj7AjQpGs Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: ac78c80460af43e0aa28dc607af188d5 Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:23:48.819110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ac78c80460af43e0aa28dc607af188d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: ac78c80460af43e0aa28dc607af188d5 Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-DeleteServersTestJSON-42660846 Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-DeleteServersTestJSON-42660846-project Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 2386a816917a4c3d97f394b07d901386 Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-DeleteServersTestJSON-42660846-project Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.820371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '7dd03df2-abc5-42f9-907e-ed5d88f1c45f'} Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:48.821015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. Aug 10 11:23:48.822243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:48.825121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] Returning 404 to user: Instance 7dd03df2-abc5-42f9-907e-ed5d88f1c45f could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:48.825121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-cb36288f-bce6-4a9c-a142-48068045cb0f tempest-DeleteServersTestJSON-42660846 tempest-DeleteServersTestJSON-42660846-project] 10.222.0.13 "GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f" status: 404 len: 111 microversion: 2.1 time: 0.034095 Aug 10 11:23:48.832158 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 92/205] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:48 2022] GET /compute/v2.1/servers/7dd03df2-abc5-42f9-907e-ed5d88f1c45f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:48.895128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:48.896346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:48.903400 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:48.904453 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:48.905000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:48.905767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:48.906323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:48.906813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:49.055630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:49.064425 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-064377af-c746-45d6-8f18-26a4089fc71f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.172976 Aug 10 11:23:49.065024 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 114/206] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:48 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:50.085468 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:50.086152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:50.093935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:50.094435 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:50.094886 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:50.095587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:50.096051 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:50.096472 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:50.230242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:50.250047 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f579d1c6-f503-43e4-8dcb-e15b5b6a75f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.168561 Aug 10 11:23:50.251184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 93/207] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:50 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:51.278173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:51.278975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:51.287678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:51.288207 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:51.288649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:51.289387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:51.289845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:51.290272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:51.479593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:51.489643 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fc092d81-7efe-40bd-949b-1c06aeda3ea4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.215544 Aug 10 11:23:51.490759 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 115/208] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:51 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:52.511378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:52.511982 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:52.518845 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:52.519305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:52.519740 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:52.520483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:52.520931 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:52.521351 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:52.949145 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:52.962256 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c84b0ccb-d17c-4eb5-829d-ac9a4f4c98c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.454846 Aug 10 11:23:52.962854 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 94/209] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:52 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:53.983941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:53.984552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:53.992463 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:53.993258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:53.993884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:53.995117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:53.995836 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:53.996397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:54.128643 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:54.136206 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5fa8c1fc-e149-4116-9d45-aa217fdaf52c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.156385 Aug 10 11:23:54.136858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 116/210] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:53 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:55.157628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:55.158896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:55.165319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:55.165809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:55.166246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:55.166928 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:55.167380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:55.167800 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:55.304831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:55.313338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-961abebd-22e7-4a64-9380-916aea700772 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.160131 Aug 10 11:23:55.313936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 95/211] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:55 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:23:55.818947 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-caf37b1e-0070-4166-9018-2eba534c9c3d tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Action: 'create', calling method: .version_select at 0x7f6f44a81160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1514178117", "metadata": {"Type": "work"}}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-caf37b1e-0070-4166-9018-2eba534c9c3d tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Request method failure captured: Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 122 Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85VLUGVu9PaT3PTdPTYiKw2A8Ym6jQ7B36gYMUF13eTiQhG7-2dzR5Gy6iTEo8fpc_buMaoD4fIxPDLhtGbDkVO0IUhSN7hCzKiup1xv8-TtaG7rkY4XaexMZo85Nl_5u1GZiSjVxhGrtFF0I6hG2qhPIFGcIWuEqMFbM5c0iLSxHo8 Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:23:55.829128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 37219377c1764896ad0f5bc10cd862fc Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1514178117", "metadata": {"Type": "work"}}} Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: Aug 10 11:23:55.830552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1514178117', 'metadata': {'Type': 'work'}}}} Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:55.831367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:23:55.832747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:23:55.833822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 11:23:55.833822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.833822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-caf37b1e-0070-4166-9018-2eba534c9c3d tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:55.833822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-caf37b1e-0070-4166-9018-2eba534c9c3d tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.125014 Aug 10 11:23:55.833822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 117/212] 10.222.0.13 () {60 vars in 1156 bytes} [Wed Aug 10 11:23:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:23:55.841241 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c93c78dc-e60c-4ab6-8e0e-d3688ae46b54 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Action: 'create', calling method: .version_select at 0x7f6f4417aaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-226593990", "metadata": {"Type": "work"}}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c93c78dc-e60c-4ab6-8e0e-d3688ae46b54 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Request method failure captured: Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 119 Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85VLUGVu9PaT3PTdPTYiKw2A8Ym6jQ7B36gYMUF13eTiQhG7-2dzR5Gy6iTEo8fpc_buMaoD4fIxPDLhtGbDkVO0IUhSN7hCzKiup1xv8-TtaG7rkY4XaexMZo85Nl_5u1GZiSjVxhGrtFF0I6hG2qhPIFGcIWuEqMFbM5c0iLSxHo8 Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:23:55.846367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 37219377c1764896ad0f5bc10cd862fc Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-226593990", "metadata": {"Type": "work"}}} Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: Aug 10 11:23:55.847976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-226593990', 'metadata': {'Type': 'work'}}}} Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi '0' Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:55.849443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:23:55.851176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:23:55.852648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 11:23:55.852648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.852648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c93c78dc-e60c-4ab6-8e0e-d3688ae46b54 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:55.852648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c93c78dc-e60c-4ab6-8e0e-d3688ae46b54 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011163 Aug 10 11:23:55.852648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 96/213] 10.222.0.13 () {60 vars in 1156 bytes} [Wed Aug 10 11:23:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 11:23:55.858705 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-11507eaf-0042-4121-b83f-fab82fd40be6 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Action: 'create', calling method: .version_select at 0x7f6f44a60b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-909205294", "metadata": {"Type": "work"}}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-11507eaf-0042-4121-b83f-fab82fd40be6 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Request method failure captured: Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 118 Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85VLUGVu9PaT3PTdPTYiKw2A8Ym6jQ7B36gYMUF13eTiQhG7-2dzR5Gy6iTEo8fpc_buMaoD4fIxPDLhtGbDkVO0IUhSN7hCzKiup1xv8-TtaG7rkY4XaexMZo85Nl_5u1GZiSjVxhGrtFF0I6hG2qhPIFGcIWuEqMFbM5c0iLSxHo8 Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:23:55.862391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 37219377c1764896ad0f5bc10cd862fc Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-909205294", "metadata": {"Type": "work"}}} Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: Aug 10 11:23:55.863977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-909205294', 'metadata': {'Type': 'work'}}}} Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise error Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi '' Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:55.866210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 11:23:55.868328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 11:23:55.870055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 11:23:55.870055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.870055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-11507eaf-0042-4121-b83f-fab82fd40be6 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:55.870055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-11507eaf-0042-4121-b83f-fab82fd40be6 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008869 Aug 10 11:23:55.870055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 118/214] 10.222.0.13 () {60 vars in 1156 bytes} [Wed Aug 10 11:23:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:23:55.876056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7d3d98db-7e26-4c68-b900-b54440700ef3 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Calling method '.version_select at 0x7f6f4415d790>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:55.906055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-7d3d98db-7e26-4c68-b900-b54440700ef3 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] HTTP exception thrown: Volume tempest-invalid-519639391 could not be found. Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7d3d98db-7e26-4c68-b900-b54440700ef3 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Request method failure captured: Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-519639391 HTTP/1.1 Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85VLUGVu9PaT3PTdPTYiKw2A8Ym6jQ7B36gYMUF13eTiQhG7-2dzR5Gy6iTEo8fpc_buMaoD4fIxPDLhtGbDkVO0IUhSN7hCzKiup1xv8-TtaG7rkY4XaexMZo85Nl_5u1GZiSjVxhGrtFF0I6hG2qhPIFGcIWuEqMFbM5c0iLSxHo8 Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:23:55.908083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 37219377c1764896ad0f5bc10cd862fc Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Volume tempest-invalid-519639391 could not be found. Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'tempest-invalid-519639391'} Aug 10 11:23:55.909517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-519639391 could not be found. (HTTP 404) (Request-ID: req-a03c150b-5cbf-4cd4-a11a-881538d56105) Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.910590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:23:55.911916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-519639391 could not be found. Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:55.913379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-519639391 could not be found. Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-519639391 could not be found. Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7d3d98db-7e26-4c68-b900-b54440700ef3 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Returning 404 to user: Volume tempest-invalid-519639391 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7d3d98db-7e26-4c68-b900-b54440700ef3 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-519639391" status: 404 len: 98 microversion: 2.1 time: 0.037707 Aug 10 11:23:55.914957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 97/215] 10.222.0.13 () {58 vars in 1215 bytes} [Wed Aug 10 11:23:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-519639391 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 11:23:55.921232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-690ee97a-c868-40fa-a0c1-3fb43d18c29e tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005295 Aug 10 11:23:55.921730 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 119/216] 10.222.0.13 () {58 vars in 1140 bytes} [Wed Aug 10 11:23:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 11:23:55.930688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1115be7c-d907-4a6f-88f0-ee92efd3b30e tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004165 Aug 10 11:23:55.931183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 98/217] 10.222.0.13 () {58 vars in 1137 bytes} [Wed Aug 10 11:23:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 11:23:55.943636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9990b927-9d18-4448-8453-960689096abf tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Calling method '.version_select at 0x7f6f44abac10>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:55.973370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-9990b927-9d18-4448-8453-960689096abf tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] HTTP exception thrown: Volume f5b76a15-2302-434f-aacb-33ceba16d2c5 could not be found. Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9990b927-9d18-4448-8453-960689096abf tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Request method failure captured: Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: DELETE /compute/v2.1/os-volumes/f5b76a15-2302-434f-aacb-33ceba16d2c5 HTTP/1.1 Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85VLUGVu9PaT3PTdPTYiKw2A8Ym6jQ7B36gYMUF13eTiQhG7-2dzR5Gy6iTEo8fpc_buMaoD4fIxPDLhtGbDkVO0IUhSN7hCzKiup1xv8-TtaG7rkY4XaexMZo85Nl_5u1GZiSjVxhGrtFF0I6hG2qhPIFGcIWuEqMFbM5c0iLSxHo8 Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:23:55.975331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 37219377c1764896ad0f5bc10cd862fc Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Volume f5b76a15-2302-434f-aacb-33ceba16d2c5 could not be found. Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'f5b76a15-2302-434f-aacb-33ceba16d2c5'} Aug 10 11:23:55.976843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5b76a15-2302-434f-aacb-33ceba16d2c5 could not be found. (HTTP 404) (Request-ID: req-c74ec3cd-4604-4c18-8162-694aa4df807f) Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.977707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 11:23:55.979001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5b76a15-2302-434f-aacb-33ceba16d2c5 could not be found. Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 11:23:55.980354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5b76a15-2302-434f-aacb-33ceba16d2c5 could not be found. Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5b76a15-2302-434f-aacb-33ceba16d2c5 could not be found. Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9990b927-9d18-4448-8453-960689096abf tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Returning 404 to user: Volume f5b76a15-2302-434f-aacb-33ceba16d2c5 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9990b927-9d18-4448-8453-960689096abf tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/f5b76a15-2302-434f-aacb-33ceba16d2c5" status: 404 len: 109 microversion: 2.1 time: 0.036999 Aug 10 11:23:55.982276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 120/218] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:23:55 2022] DELETE /compute/v2.1/os-volumes/f5b76a15-2302-434f-aacb-33ceba16d2c5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:55.987687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f2267e74-9e9a-4c4a-80e8-e7eecec99982 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Calling method '.version_select at 0x7f6f4417af70>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:56.031126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-f2267e74-9e9a-4c4a-80e8-e7eecec99982 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] HTTP exception thrown: Volume fe738816-d8c3-4933-93da-9aec989080dc could not be found. Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f2267e74-9e9a-4c4a-80e8-e7eecec99982 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Request method failure captured: Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/os-volumes/fe738816-d8c3-4933-93da-9aec989080dc HTTP/1.1 Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85VLUGVu9PaT3PTdPTYiKw2A8Ym6jQ7B36gYMUF13eTiQhG7-2dzR5Gy6iTEo8fpc_buMaoD4fIxPDLhtGbDkVO0IUhSN7hCzKiup1xv8-TtaG7rkY4XaexMZo85Nl_5u1GZiSjVxhGrtFF0I6hG2qhPIFGcIWuEqMFbM5c0iLSxHo8 Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:23:56.033354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b572cbc25b254d6bb9c4c94e4e97608f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: b572cbc25b254d6bb9c4c94e4e97608f Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesNegativeTest-932719052 Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 37219377c1764896ad0f5bc10cd862fc Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesNegativeTest-932719052-project Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Volume fe738816-d8c3-4933-93da-9aec989080dc could not be found. Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'fe738816-d8c3-4933-93da-9aec989080dc'} Aug 10 11:23:56.034535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fe738816-d8c3-4933-93da-9aec989080dc could not be found. (HTTP 404) (Request-ID: req-fda24f42-c1ef-449a-8885-82403f41d1e5) Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:56.035210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 11:23:56.037081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fe738816-d8c3-4933-93da-9aec989080dc could not be found. Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 11:23:56.038014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fe738816-d8c3-4933-93da-9aec989080dc could not be found. Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fe738816-d8c3-4933-93da-9aec989080dc could not be found. Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f2267e74-9e9a-4c4a-80e8-e7eecec99982 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] Returning 404 to user: Volume fe738816-d8c3-4933-93da-9aec989080dc could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f2267e74-9e9a-4c4a-80e8-e7eecec99982 tempest-VolumesNegativeTest-932719052 tempest-VolumesNegativeTest-932719052-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/fe738816-d8c3-4933-93da-9aec989080dc" status: 404 len: 109 microversion: 2.1 time: 0.051103 Aug 10 11:23:56.041323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 99/219] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:23:55 2022] GET /compute/v2.1/os-volumes/fe738816-d8c3-4933-93da-9aec989080dc => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:23:56.338526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:56.338526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:56.343188 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:56.343680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:56.344138 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:56.344830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:56.345281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:56.345699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:56.493088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:56.500985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-416ddd68-5e4e-481b-b78b-45c560a9c3f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.169961 Aug 10 11:23:56.501537 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 121/220] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:56 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:57.525710 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:57.526343 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:57.533534 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:57.534024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:57.534522 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:57.535224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:57.535979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:57.536508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:57.701578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:57.712878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-faced046-f44c-406d-9a07-6a9524e0578e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.194457 Aug 10 11:23:57.716132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 100/221] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:57 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:58.738247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:58.738992 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:58.745092 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:58.745760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:58.746199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:58.747965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:58.748463 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:58.749282 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:58.891933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:23:58.899438 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-251abfbb-e3a0-448a-ab01-9f4fe3d54096 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.165192 Aug 10 11:23:58.900015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 122/222] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:58 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:23:59.929612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:23:59.929612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:23:59.929612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:59.930216 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:59.930551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:23:59.931907 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:23:59.932477 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:23:59.932962 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:00.071920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:00.082087 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ce429024-3e98-439a-806c-927b3c555b60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.164601 Aug 10 11:24:00.089714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 101/223] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:23:59 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:01.109084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:01.109699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:01.115570 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:01.116086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:01.116519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:01.117228 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:01.117671 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:01.118097 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:01.256479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:01.264925 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-bbcdae94-e1a3-4025-8895-44ff066ff4a3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.159811 Aug 10 11:24:01.265503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 123/224] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:01 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:02.153490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1120556766", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:02.208829 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] validate_networks() for None {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:24:02.290779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:02.292372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:02.298518 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:02.299031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:02.299652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:02.300603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:02.301057 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:02.304167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:02.565591 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:02.574411 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9275cc55-43d9-465f-a919-e80da652aa02 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.286977 Aug 10 11:24:02.574633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 124/225] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:02 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:02.603716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:24:02.605591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:24:02.605591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:24:02.605591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:24:02.605591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:24:02.615444 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:02.616063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:02.616696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:02.617447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:02.618135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:02.618431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:02.636249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Getting quotas for project 29447f0b81cb4a8bbeab875115c2b542. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:24:02.640467 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Getting quotas for user a1c55eb65703476994509add9731e0db and project 29447f0b81cb4a8bbeab875115c2b542. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:24:02.651580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:24:02.654076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:24:02.847287 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6145a01a-faf6-4677-bbda-759fda290175 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697799 Aug 10 11:24:02.847933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 102/226] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:24:02.859105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ff776dcb-c3ef-4326-bdfd-2a1bc3d0a629 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:02.859711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ff776dcb-c3ef-4326-bdfd-2a1bc3d0a629 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:02.914778 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ff776dcb-c3ef-4326-bdfd-2a1bc3d0a629 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:02.924556 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ff776dcb-c3ef-4326-bdfd-2a1bc3d0a629 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1215 microversion: 2.1 time: 0.069386 Aug 10 11:24:02.926233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 125/227] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:02 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:03.597297 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:03.598051 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:03.605264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:03.608681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:03.608681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:03.608681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:03.608681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:03.609070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:03.747290 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:03.755823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-08122af4-845b-4ff3-bef6-2ca85f3f06f2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.164136 Aug 10 11:24:03.756441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 103/228] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:03 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:03.945507 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8e403996-370a-41bb-bf4f-05d1b6a1dd8b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:03.946115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8e403996-370a-41bb-bf4f-05d1b6a1dd8b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:03.998634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8e403996-370a-41bb-bf4f-05d1b6a1dd8b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:04.006390 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8e403996-370a-41bb-bf4f-05d1b6a1dd8b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1215 microversion: 2.1 time: 0.064756 Aug 10 11:24:04.006965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 126/229] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:03 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:04.779509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:04.780240 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:04.787159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:04.787758 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:04.788304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:04.789071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:04.789598 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:04.790115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:04.947058 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:04.956759 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-eaef3ae0-0165-4df0-bd6a-d9762c6d3fcb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.183050 Aug 10 11:24:04.957436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 104/230] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:04 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:05.026800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:05.027485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:05.034046 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:05.034615 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:05.035565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:05.036343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:05.036906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:05.037337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:05.114798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:05.125228 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5b0c0993-926b-4af6-9dfc-42004bf2975f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1267 microversion: 2.1 time: 0.102104 Aug 10 11:24:05.140239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 127/231] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:05 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:05.978709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:05.979319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:05.988513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:05.989325 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:05.989986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:05.991345 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:05.991838 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:05.992667 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:06.129509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:06.137071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ee621669-0688-4de9-947f-bd2cb6dc94ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.162227 Aug 10 11:24:06.137741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 105/232] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:05 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:06.148282 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:06.149031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:06.164568 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:06.165083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:06.165585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:06.166319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:06.166668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:06.167094 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:06.260735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:06.269119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4e250e6b-952b-49c4-8b50-32692fc72c93 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1273 microversion: 2.1 time: 0.124866 Aug 10 11:24:06.269690 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 128/233] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:06 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:07.158500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:07.159465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:07.166802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:07.169627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:07.169627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:07.170287 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:07.170947 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:07.171796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:07.291943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:07.295051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:07.315842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:07.318852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:07.318852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:07.318852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:07.318852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:07.319389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:07.333177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:07.341934 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e06f1c7c-e773-4201-ae4a-9b161b4aa21d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.187493 Aug 10 11:24:07.342512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 106/234] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:07 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:07.492954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:07.501448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-44dcf4d8-fa03-4d1f-90b8-94591cb5e05b tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.214540 Aug 10 11:24:07.502303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 129/235] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:07 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:07.871203 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-38d88a7f-5427-4a97-9e2f-8cec38701255 req-d39d3a9d-d492-4264-9362-89259663aeeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf28f79-8876-491f-8e84-3937446e93f3", "tag": "24db04c4-3ca3-4700-9001-dbef753722b1"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:07.881267 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-38d88a7f-5427-4a97-9e2f-8cec38701255 req-d39d3a9d-d492-4264-9362-89259663aeeb service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:07.881734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-38d88a7f-5427-4a97-9e2f-8cec38701255 req-d39d3a9d-d492-4264-9362-89259663aeeb service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:07.882149 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-38d88a7f-5427-4a97-9e2f-8cec38701255 req-d39d3a9d-d492-4264-9362-89259663aeeb service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:08.042643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-38d88a7f-5427-4a97-9e2f-8cec38701255 req-d39d3a9d-d492-4264-9362-89259663aeeb service nova] Creating event network-changed:24db04c4-3ca3-4700-9001-dbef753722b1 for instance 8cf28f79-8876-491f-8e84-3937446e93f3 on hv-cinder-85061 Aug 10 11:24:08.048594 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-38d88a7f-5427-4a97-9e2f-8cec38701255 req-d39d3a9d-d492-4264-9362-89259663aeeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181745 Aug 10 11:24:08.049478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 107/236] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:08.362896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:08.363543 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:08.369767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:08.370266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:08.370698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:08.372391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:08.373019 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:08.373621 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:08.519184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:08.523557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:08.524312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:08.527065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a45cb5c9-e055-41db-b7ed-84590eb346fd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.167959 Aug 10 11:24:08.527693 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 130/237] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:08 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:08.532401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:08.533822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:08.533822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:08.534126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:08.534585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:08.535010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:08.666824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:08.674838 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3cd66007-14bb-4dfa-ac23-ddb31bc401cb tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.156290 Aug 10 11:24:08.677424 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 108/238] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:08 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:09.554312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:09.555002 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:09.562295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:09.562988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:09.563400 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:09.564114 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:09.564768 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:09.565190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:09.696684 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:09.701394 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:09.702219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:09.705727 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:09.706214 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:09.706652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:09.707380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:09.707833 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:09.708285 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:09.709700 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3a0f38f0-d445-4f03-b1d5-e7a406dd6907 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.159440 Aug 10 11:24:09.710423 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 131/239] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:09 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:09.723432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:09.845526 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:09.852967 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a152158b-4613-47b7-84b5-0ae114ebf216 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.160905 Aug 10 11:24:09.853616 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 109/240] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:09 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:10.730669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:10.731480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:10.737408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:10.737890 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:10.738317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:10.738999 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:10.739446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:10.739867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:10.874927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:10.875537 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:10.877190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:10.878194 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:10.887923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dcccbde7-9dcb-4e5c-a918-e7db61ca6b07 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.158862 Aug 10 11:24:10.887923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 132/241] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:10 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:10.888209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:10.888209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:10.889143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:10.890175 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:10.891227 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:10.892177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:11.042716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:11.050737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3e54a366-dcb2-43c3-891d-604ab64c65fe tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.180996 Aug 10 11:24:11.051305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 110/242] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:10 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:11.919009 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:11.927011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:11.943338 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:11.944989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:11.946410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:11.948277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:11.951421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:11.951991 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:12.073852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:12.075854 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:12.082905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:12.083607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:12.084071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:12.084893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:12.085510 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:12.088379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:12.103214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:12.111487 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-bd223b3d-ff94-4b16-8a7f-df2b31576fcd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.196660 Aug 10 11:24:12.112313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 133/243] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:11 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:12.247086 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:12.254938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fedb595a-7ca3-4645-b1b5-445770ba055a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.185952 Aug 10 11:24:12.256044 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 111/244] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:12 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:13.133634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:13.134367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:13.140397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:13.140884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:13.141315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:13.141998 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:13.142450 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:13.142867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:13.281865 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:13.292338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:13.297138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:13.297138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=6 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:13.307364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:13.308235 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:13.313560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:13.314798 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:13.315411 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:13.315987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:13.444482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:13.454987 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-729de22c-69f4-400e-b25a-5ff40936a53d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.325199 Aug 10 11:24:13.455557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 134/245] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:13 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:13.536264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:13.545913 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9f5840ea-9a76-445d-959e-7b3b959fb8ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.271627 Aug 10 11:24:13.546489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 112/246] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:13 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:14.487846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:14.488485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:14.490338 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:14.495000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:14.495481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:14.495967 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:14.499435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:14.499435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:14.499435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:14.501746 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:14.567457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:14.567972 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:14.576169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:14.577186 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:14.577392 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:14.578109 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:14.578556 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:14.579010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:14.660942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:14.670266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c7aaeed4-dc7e-408e-8ca9-a53fc4ca57ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.186134 Aug 10 11:24:14.671201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 135/247] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:14 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:14.728345 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:14.736227 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-419e5ce0-0b2a-4150-9b72-a1291942444c tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.172658 Aug 10 11:24:14.736783 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 113/248] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:14 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:15.694460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:15.695197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:15.704284 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:15.704762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:15.705188 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:15.705871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:15.706313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:15.706726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:15.759973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:15.761229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:15.769995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:15.770782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:15.771410 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:15.773008 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:15.773667 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:15.774245 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:15.920606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:15.928565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-500fcb4e-caf6-48d9-9717-78f1de8f508e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.238214 Aug 10 11:24:15.929591 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 136/249] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:15 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:15.953938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:15.961365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6f4c26c1-1edb-4c1b-aef3-0ce7d5f36d05 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.208617 Aug 10 11:24:15.962385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 114/250] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:15 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:16.951068 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:16.951673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:16.957702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:16.958173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:16.958613 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:16.963891 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:16.964307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:16.964751 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:16.984434 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:16.985386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:16.991940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:16.992445 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:16.992877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:16.993572 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:16.994024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:16.994448 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:17.178132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:17.182873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:17.188843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-aa660235-3342-4440-8a26-a2a81a2a97fb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.241030 Aug 10 11:24:17.188843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 137/251] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:16 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:17.194190 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-be0c5c3c-9f2b-4b04-99ee-6a352a93bce4 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.211982 Aug 10 11:24:17.194993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 115/252] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:16 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:18.209139 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:18.209747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:18.216401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.216887 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.217322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.218011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.218470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.218894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.221279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:18.221885 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:18.228284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.228763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.229197 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.229883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:18.230339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:18.230903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:18.424276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:18.428543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:18.431689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4445c69d-9c39-4997-bd61-83618e339ccc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.226358 Aug 10 11:24:18.432291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 138/253] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:18 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:18.436336 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c1f5d843-9f4c-453e-be4b-937c862fa2bc tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.218816 Aug 10 11:24:18.436893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 116/254] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:18 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:19.453626 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:19.454457 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:19.458136 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:19.458978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:19.460706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:19.461197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:19.461634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:19.462328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:19.462895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:19.463328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:19.467328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:19.467910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:19.468517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:19.469371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:19.469884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:19.470377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:19.661447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:19.665425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:19.670065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-37311500-6b41-49cb-b58b-fb1d5f23e95b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.220236 Aug 10 11:24:19.670648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 139/255] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:19 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:19.673852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fc103c84-30d1-44cf-acf5-fab37f4ba2ba tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.221030 Aug 10 11:24:19.674411 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 117/256] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:19 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:20.700602 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:20.701342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:20.704264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:20.705499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:20.710162 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:20.710741 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:20.711539 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:20.712351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:20.712997 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:20.713882 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:20.715696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:20.716447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:20.716889 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:20.717643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:20.718093 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:20.718569 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:20.924525 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:20.927592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:20.932211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-619477f7-90da-491e-8b8c-2370681f4ff7 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.233915 Aug 10 11:24:20.932859 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 118/257] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:20 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:20.936093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-15bd4452-d3ef-4f17-9810-67a605f87213 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.240856 Aug 10 11:24:20.936886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 140/258] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:20 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:20.943782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-61074448-80bf-4ac2-aa95-2ccb461032c2 req-4c741e2d-d389-4023-a2d4-1dcadaef4a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf28f79-8876-491f-8e84-3937446e93f3", "name": "network-vif-plugged", "status": "completed", "tag": "24db04c4-3ca3-4700-9001-dbef753722b1"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:20.948334 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-61074448-80bf-4ac2-aa95-2ccb461032c2 req-4c741e2d-d389-4023-a2d4-1dcadaef4a57 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:20.948795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-61074448-80bf-4ac2-aa95-2ccb461032c2 req-4c741e2d-d389-4023-a2d4-1dcadaef4a57 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:20.949466 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-61074448-80bf-4ac2-aa95-2ccb461032c2 req-4c741e2d-d389-4023-a2d4-1dcadaef4a57 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:20.960986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-61074448-80bf-4ac2-aa95-2ccb461032c2 req-4c741e2d-d389-4023-a2d4-1dcadaef4a57 service nova] Creating event network-vif-plugged:24db04c4-3ca3-4700-9001-dbef753722b1 for instance 8cf28f79-8876-491f-8e84-3937446e93f3 on hv-cinder-85061 Aug 10 11:24:20.966963 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-61074448-80bf-4ac2-aa95-2ccb461032c2 req-4c741e2d-d389-4023-a2d4-1dcadaef4a57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032870 Aug 10 11:24:20.967562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 119/259] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:21.954131 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:21.954738 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:21.956593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=52 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:21.960894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:21.961349 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:21.961619 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:21.961726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:21.962110 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:21.962798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:21.963396 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:21.963978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:21.969142 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:21.969650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:21.970263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:21.970965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:21.971418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:21.971844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:22.372415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:22.375701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:22.380519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d19e37d7-7930-42df-a3f9-c6ba6aff562f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.430806 Aug 10 11:24:22.384062 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c8b369ac-25a5-42f9-9a34-392d29f12b47 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.429862 Aug 10 11:24:22.386026 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 120/260] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:21 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:22.390774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 141/261] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:21 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:23.401824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:23.403001 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:23.409834 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:23.415516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:23.415516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:23.415516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:23.415516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:23.415851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:23.416607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:23.417748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:23.424266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:23.424753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:23.425183 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:23.425875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:23.426324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:23.426744 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:23.618047 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:23.621848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:23.626641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7b298aea-39a4-4f23-b335-238cb1921ae9 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.228610 Aug 10 11:24:23.627153 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 121/262] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:23 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:23.629321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a788e98c-9855-41ba-aaec-03d9c95d7da1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.216606 Aug 10 11:24:23.629886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 142/263] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:23 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:24.646515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:24.647353 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:24.652246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:24.653693 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:24.658151 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:24.658151 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:24.658151 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:24.658151 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:24.658586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:24.658746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:24.658912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:24.659374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:24.659812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:24.660536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:24.660985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:24.661416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:24.864594 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:24.868254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:24.876080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-41ce4b72-60b9-42d1-9f2f-c9b4fa72a5ae tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.230596 Aug 10 11:24:24.876080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 122/264] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:24 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:24.877764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-82e76720-235d-4603-ab98-348624924ab2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1523 microversion: 2.1 time: 0.229337 Aug 10 11:24:24.878401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 143/265] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:24 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:25.894279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:25.894894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:25.899874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:25.900551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:25.902472 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.902965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.904041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.904227 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.904871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.910585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.911191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.911191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.911191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:25.911417 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:25.912172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:25.912519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:26.151478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:26.166902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8b003202-833a-421a-9631-0336c8f7a37f tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1315 microversion: 2.1 time: 0.275868 Aug 10 11:24:26.168011 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 123/266] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:25 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:26.171234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:26.180086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-86e021e4-baf5-41a9-8b43-1d8b463b34f0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1503 microversion: 2.1 time: 0.284546 Aug 10 11:24:26.181670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 144/267] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:25 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1503 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:26.201568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:26.202178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:26.208276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:26.208677 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:26.209112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:26.209802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:26.210250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:26.210672 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:26.347128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:26.354842 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-665c0006-8283-4b8e-b975-5534f2ac70ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1517 microversion: 2.1 time: 0.157445 Aug 10 11:24:26.355740 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 124/268] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:26 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:27.188295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:27.188895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:27.194804 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.195303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.195730 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.196433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.196874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.197363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.334194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:27.342387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9c042e42-ea9c-4eeb-8511-95ba44a9b936 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1465 microversion: 2.1 time: 0.158011 Aug 10 11:24:27.342976 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 145/269] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:27 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:27.390795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:27.391327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:27.403092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.403092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.403092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.403092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.403412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.403412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.425422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:24:27.457053 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:27.783568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-64b00dcb-6bac-491a-a1ae-2ca2623b896e tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 204 len: 0 microversion: 2.1 time: 0.397091 Aug 10 11:24:27.784204 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 125/270] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:24:27 2022] DELETE /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:24:27.792402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:27.793083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:27.798898 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.799371 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.799824 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.800527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:27.800970 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:27.801386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:27.937970 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:27.945555 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0dad45f7-12ee-4278-baec-549d8d09563a tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1471 microversion: 2.1 time: 0.157044 Aug 10 11:24:27.946109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 146/271] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:27 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:28.967724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:28.968460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:28.974769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:28.975240 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:28.975670 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:28.976387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:28.976840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:28.977260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:29.111808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:29.119291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-883704cd-087a-4155-9031-e24bcac39d44 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1471 microversion: 2.1 time: 0.156428 Aug 10 11:24:29.119856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 126/272] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:28 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:30.140491 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:30.141082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:30.146930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:30.147402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:30.147828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:30.148527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:30.148972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:30.149389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:30.277811 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:30.285300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-07eef5fb-69e4-460d-92d9-d0ef61929078 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1471 microversion: 2.1 time: 0.148647 Aug 10 11:24:30.285857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 147/273] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:30 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:31.306621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:31.307178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:31.314161 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:31.314645 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:31.315080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:31.315763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:31.316241 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:31.316668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:31.452263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:31.459959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7027bfb9-197c-4c1c-875f-87acfa5f00f3 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1471 microversion: 2.1 time: 0.157291 Aug 10 11:24:31.460560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 127/274] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:31 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:32.480824 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:32.481492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:32.487785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:32.488334 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:32.488767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:32.489446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:32.489892 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:32.490308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:32.624492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:32.631927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6876dba7-5ed3-48fd-8900-4425dd1ba670 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1471 microversion: 2.1 time: 0.154865 Aug 10 11:24:32.632528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 148/275] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:32 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:33.264433 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-1e6d4873-babc-4246-966e-e1906dea5277 req-b0518d4b-f398-4b75-a414-4076544624fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf28f79-8876-491f-8e84-3937446e93f3", "name": "network-vif-deleted", "tag": "24db04c4-3ca3-4700-9001-dbef753722b1"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:33.272069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-1e6d4873-babc-4246-966e-e1906dea5277 req-b0518d4b-f398-4b75-a414-4076544624fd service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.272555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-1e6d4873-babc-4246-966e-e1906dea5277 req-b0518d4b-f398-4b75-a414-4076544624fd service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.272985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-1e6d4873-babc-4246-966e-e1906dea5277 req-b0518d4b-f398-4b75-a414-4076544624fd service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.286126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-1e6d4873-babc-4246-966e-e1906dea5277 req-b0518d4b-f398-4b75-a414-4076544624fd service nova] Creating event network-vif-deleted:24db04c4-3ca3-4700-9001-dbef753722b1 for instance 8cf28f79-8876-491f-8e84-3937446e93f3 on hv-cinder-85061 Aug 10 11:24:33.291576 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-1e6d4873-babc-4246-966e-e1906dea5277 req-b0518d4b-f398-4b75-a414-4076544624fd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034416 Aug 10 11:24:33.292378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 128/276] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:24:33.653408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:33.654017 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:33.659906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.660414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.660844 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.661522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.661996 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.662417 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.692089 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:33.692566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:33.692997 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:33.693449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lazy-loading 'fault' on Instance uuid 8cf28f79-8876-491f-8e84-3937446e93f3 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:33.739376 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c55eb65703476994509add9731e0db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29447f0b81cb4a8bbeab875115c2b542', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:33.747682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7fc6cf92-a542-42fa-9a75-bce6c3d3e232 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 200 len: 1305 microversion: 2.1 time: 0.099140 Aug 10 11:24:33.751953 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 149/277] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:33 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:34.769185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:34.769844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] [instance: 8cf28f79-8876-491f-8e84-3937446e93f3] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:34.776776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:34.777941 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:34.778382 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:34.779112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:34.779573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:34.780022 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:34.795483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] HTTP exception thrown: Instance 8cf28f79-8876-491f-8e84-3937446e93f3 could not be found. Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Request method failure captured: Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 HTTP/1.1 Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85VO78AcD1ju_VhSdYGSfcM0WUQbW1efaI4ImgDDjiJFwn5JhE-7Jdba06NszGCzUTJNPDAMfqCY0SLGJQe1R3FfLgVK-EPlETbcvIJ9f4KO1ly-lMsp1Dsofca8FSrcksLvWHEEN11C7fxQRYfetAk9F48Zs5ebnOAasqJ8bciIuj0 Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 29447f0b81cb4a8bbeab875115c2b542 Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesNegativeTest-1608891501 Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:24:34.797319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/29447f0b81cb4a8bbeab875115c2b542"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/29447f0b81cb4a8bbeab875115c2b542"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/29447f0b81cb4a8bbeab875115c2b542"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_29447f0b81cb4a8bbeab875115c2b542"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesNegativeTest-1608891501 Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 29447f0b81cb4a8bbeab875115c2b542 Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesNegativeTest-1608891501 Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesNegativeTest-1608891501-project Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: a1c55eb65703476994509add9731e0db Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesNegativeTest-1608891501-project Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 8cf28f79-8876-491f-8e84-3937446e93f3 could not be found. Aug 10 11:24:34.798749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '8cf28f79-8876-491f-8e84-3937446e93f3'} Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf28f79-8876-491f-8e84-3937446e93f3 could not be found. Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:34.799475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf28f79-8876-491f-8e84-3937446e93f3 could not be found. Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf28f79-8876-491f-8e84-3937446e93f3 could not be found. Aug 10 11:24:34.800693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:24:34.808698 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] Returning 404 to user: Instance 8cf28f79-8876-491f-8e84-3937446e93f3 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:34.808698 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-dc55607c-5530-419b-baba-63448ada3e75 tempest-VolumesNegativeTest-1608891501 tempest-VolumesNegativeTest-1608891501-project] 10.222.0.13 "GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3" status: 404 len: 111 microversion: 2.1 time: 0.033865 Aug 10 11:24:34.808698 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 129/278] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:34 2022] GET /compute/v2.1/servers/8cf28f79-8876-491f-8e84-3937446e93f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:24:36.804832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:36.804832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:36.804832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:36.804832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:36.805507 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:36.805507 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:36.805507 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:36.805507 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:36.805800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lazy-loading 'flavor' on Instance uuid 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:24:36.866086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:37.307485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a2a355b5-efd1-4f3d-86a3-e8610e497a6d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80/action" status: 200 len: 32 microversion: 2.1 time: 0.545743 Aug 10 11:24:37.308120 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 150/279] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:24:36 2022] POST /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80/action => generated 32 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:24:37.318882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:37.319498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:37.326226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:37.326710 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:37.327200 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:37.327841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:37.328320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:37.328744 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:37.469607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:37.477479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e0531ef1-f63e-4dfe-b21f-d27c7e1b0f6f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.162570 Aug 10 11:24:37.478051 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 130/280] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:37 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:38.499755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:38.500581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:38.506556 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:38.507034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:38.507463 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:38.508180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:38.508624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:38.509039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:38.673923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:38.681675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ea7ba38b-90e6-484f-8b8e-77ceba291cb5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.186655 Aug 10 11:24:38.689592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 151/281] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:38 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:39.704628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:39.705294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:39.711752 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.712306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.712743 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.713466 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:39.713910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:39.714326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:39.880373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:39.888483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fbd735c8-96df-47e6-a2b8-db195df66e30 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.187745 Aug 10 11:24:39.889037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 131/282] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:39 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:40.909651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:40.910256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:40.916258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:40.918679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:40.918679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:40.918679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:40.918989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:40.919413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:41.113601 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:41.133445 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cf4d7b42-8c79-4b63-80b4-f337e6554d70 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.227581 Aug 10 11:24:41.134347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 152/283] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:40 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:42.167233 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:42.168871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:42.171097 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:42.175866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:42.176482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:42.176999 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:42.177806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:42.178257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:42.178702 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:42.379837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:42.388724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bff8f8b5-6a0d-4aa2-975d-0b8e6e6bea68 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.225443 Aug 10 11:24:42.389582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 132/284] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:42 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:43.411347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:43.411973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:43.423221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:43.423729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:43.424464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:43.424891 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:43.429598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:43.429991 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:43.707215 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:43.718740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0e4a8357-366a-4ae4-9193-e31532e0bab7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.309538 Aug 10 11:24:43.719345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 153/285] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:43 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:44.744275 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:44.745403 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:44.756623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.757267 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.757810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.759352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:44.760350 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:44.761047 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:44.920183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:44.929338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-42225d7b-5f63-469f-990c-25a46ce9e4f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.189841 Aug 10 11:24:44.930976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 133/286] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:44 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:45.960413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:45.961607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:45.970766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:45.971533 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:45.972301 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:45.973380 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:45.974018 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:45.974628 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:46.122302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:46.132858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-69888508-60e1-4ff4-b571-10d9c2b51af0 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.179192 Aug 10 11:24:46.133680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 154/287] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:45 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:47.159504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:47.160152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:47.167343 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:47.168408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:47.169137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:47.169837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:47.170298 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:47.170722 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:47.321923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:47.338643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e60eefe7-2061-464b-89f3-3ac7b844e32c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.187749 Aug 10 11:24:47.340388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 134/288] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:47 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:48.361079 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:48.361678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:48.367926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:48.368702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:48.369304 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:48.370346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:48.371685 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:48.372514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:48.599582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:48.607881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4e8486fb-9dc1-4268-90a5-7b4a873be02e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.250756 Aug 10 11:24:48.612047 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 155/289] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:48 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:49.630212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:49.630921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:49.638161 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.638732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.639238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.640036 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:49.640546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:49.645599 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:49.894651 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:49.904393 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-25692f6d-0b57-4d6c-a8cb-324012676793 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.278024 Aug 10 11:24:49.912643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 135/290] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:49 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:50.927898 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:50.929297 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:50.943773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.947042 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.960863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:50.960863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:50.960863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:50.960863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:51.180429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:51.194679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-97e5e55e-286e-4ab9-bf09-b733389605e6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.270428 Aug 10 11:24:51.208024 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 156/291] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:50 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:52.218288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:52.218806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:52.225164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.225888 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.226490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.227519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:52.228156 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:52.228755 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:52.577552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:52.590778 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-eb3c7bf9-9cce-432d-b869-603cda8502eb tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.376491 Aug 10 11:24:52.594558 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 136/292] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:52 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:53.627161 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:53.627758 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:53.629813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=34 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:53.641137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.641963 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.642615 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:53.643626 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:53.644340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:53.644975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:54.004317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:54.014257 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ec1d4841-02b0-4a9a-9eac-937299ee6f1d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.403345 Aug 10 11:24:54.015414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 157/293] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:53 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:55.037121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:55.037744 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:55.050532 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.051050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.051500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.052265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:55.052745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:55.053141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:55.385118 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:55.398995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c70e1cc7-b16f-44b2-ae50-35942decd63f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.365839 Aug 10 11:24:55.399557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 137/294] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:55 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:24:56.420863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:56.426956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:56.456545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.456545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.463227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.464938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:56.465662 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:56.466348 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:56.768159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:56.778415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3258fd04-8f61-4086-b6cc-288c2f4f68f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.361954 Aug 10 11:24:56.779855 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 158/295] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:56 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:57.149701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-af819a12-7181-4272-8b94-f5699d21c64f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Action: 'create', calling method: .version_select at 0x7f6f4437c9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-437234834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQN58G+h4Lot7junU9T2eMmqqUhUrEQpleISuv3YEd1CtB6S1+Inf8ftcdPkkDB0ig/NXKG6gW7S/ivte7QZeEV2TrRzWhM22WeY1Ka4tNWT3U4Y0e0Nym09ZVy1Prtpg=="}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:57.166238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-af819a12-7181-4272-8b94-f5699d21c64f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Getting quotas for project e05759c8ab0248e58d35630a611912f0. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:24:57.170541 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-af819a12-7181-4272-8b94-f5699d21c64f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Getting quotas for user 46dffe5f71cf4d2ca7bf42f86d2bb07a and project e05759c8ab0248e58d35630a611912f0. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:24:57.360049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-af819a12-7181-4272-8b94-f5699d21c64f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.458132 Aug 10 11:24:57.365444 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 138/296] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:24:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:24:57.800021 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:57.800641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:57.806512 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.806990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.807421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.808443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:57.808902 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:57.809324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:57.967590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:57.982351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3b98c556-3050-44ca-bde2-7fe0c89989e8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.179084 Aug 10 11:24:57.982351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 159/297] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:57 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:58.998030 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:58.998634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:59.014607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.015619 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.016552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.017312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.017757 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.018809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.045461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:24:59.347527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:24:59.357095 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-17bb1157-b2ab-4a57-8d8a-1c3dcf149d5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1503 microversion: 2.1 time: 0.362887 Aug 10 11:24:59.359023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 139/298] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:58 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:24:59.381489 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96944fd0-c138-4008-a0b3-5cbf12b3b08f"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:59.385931 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:59.393566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.394281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.395798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.396719 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.397322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.397895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.429266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] HTTP exception thrown: Cannot 'attach_volume' instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 while it is in vm_state rescued Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Request method failure captured: Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: POST /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80/os-volume_attachments HTTP/1.1 Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 74 Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHwu4FUR1_6OifWImd_SAoLvZrJFAvoiHwxJf-Mi0BuQaKZ6BnuSgu648_Z7D4SbmaZtsmt0NYxxeKVeDrQz34LCrsGWwa4sD3bm004i3qaMtU1umyDyLQRBIYUkSx4m7-GrNzpO-X4fjlKSktXQwvPigXNg1NLVD20w2HraTJPXI Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:24:59.430965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 9b5890ee9a114299b0a15a6608503632 Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {"volumeAttachment": {"volumeId": "96944fd0-c138-4008-a0b3-5cbf12b3b08f"}} Aug 10 11:24:59.432169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Cannot 'attach_volume' instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 while it is in vm_state rescued Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'server_id': '7efa0d4f-5ba3-4b0b-a331-ce5dab394d80', 'body': {'volumeAttachment': {'volumeId': '96944fd0-c138-4008-a0b3-5cbf12b3b08f'}}} Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:24:59.432869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 while it is in vm_state rescued Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:24:59.434011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:24:59.436258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:24:59.436258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:24:59.436258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 while it is in vm_state rescued Aug 10 11:24:59.436258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:24:59.436258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Returning 409 to user: Cannot 'attach_volume' instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 while it is in vm_state rescued {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:24:59.436258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7c0de109-6831-4cf6-9c90-db33c78dd9a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055907 Aug 10 11:24:59.440784 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 160/299] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:24:59 2022] POST /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 11:24:59.442848 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:24:59.443393 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:59.451308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.451808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.452322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.453018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.453463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.453882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.791336 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3cb7a484-234b-4221-b7e1-0777cb673527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80/action" status: 202 len: 0 microversion: 2.1 time: 0.352553 Aug 10 11:24:59.802024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 140/300] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:24:59 2022] POST /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:24:59.811829 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:24:59.812727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:24:59.824652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.825436 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.825876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:24:59.832181 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:24:59.836726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:24:59.836726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:00.485178 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:00.492866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-734f7fbf-95e9-4f28-8a4d-0d7f767e22e4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1511 microversion: 2.1 time: 0.686751 Aug 10 11:25:00.493438 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 161/301] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:24:59 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1511 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:01.520971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:01.522258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:01.575978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:01.576596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:01.577048 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:01.577793 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:01.578253 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:01.581612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:02.151780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:02.162752 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-94bf6c64-f34b-477f-a939-139a23bb8b21 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1511 microversion: 2.1 time: 0.649946 Aug 10 11:25:02.165917 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 141/302] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:01 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:03.191785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:03.194241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:03.218430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:03.220143 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:03.221619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:03.222730 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:03.223404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:03.225596 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:03.415711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:03.426299 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a3335b8b-5f26-438a-bbad-72a22890ae95 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1511 microversion: 2.1 time: 0.241036 Aug 10 11:25:03.429573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 162/303] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:03 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:04.455279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:04.456561 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:04.467591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:04.468495 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:04.468929 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:04.469819 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:04.470275 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:04.470837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:04.628571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:04.637968 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a85c4a74-24bc-49aa-8fc5-eda9d19b2dc2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1517 microversion: 2.1 time: 0.187533 Aug 10 11:25:04.638564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 142/304] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:04 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:07.642454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-567b333b-734a-4764-b4fc-1dce20c5a9e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'create', calling method: .version_select at 0x7f6f449e0670>, body: {"keypair": {"name": "tempest-keypair-1562072889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGdUOFarg0w1mZukVKHJ0qEk3xUo/SqKkNlgee2jfDP6Xp3V+otjahN2c+JO2rRYqFe45K2sKy3ILK6nKY1bmw0fFpGMhF0ksmIRP145CqZ2qMkvDuwcmqOLQ3XicvKNQ=="}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:07.667937 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-567b333b-734a-4764-b4fc-1dce20c5a9e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Getting quotas for project 526e4ff2ae594d54a53e628df8802a92. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:25:07.672459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-567b333b-734a-4764-b4fc-1dce20c5a9e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Getting quotas for user 9b5890ee9a114299b0a15a6608503632 and project 526e4ff2ae594d54a53e628df8802a92. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:25:07.797518 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-567b333b-734a-4764-b4fc-1dce20c5a9e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160953 Aug 10 11:25:07.807098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 163/305] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:25:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:12.058949 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1526366641", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e250d256-e01c-4e22-9b87-b8c02fd3002e"}], "security_groups": [{"name": "tempest-securitygroup--1689365786"}], "key_name": "tempest-keypair-1562072889", "user_data": "}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:12.073292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=4 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:13.645900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1802157688", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "networks": [{"uuid": "b0311c2f-c020-471c-8a70-8d7130b50197"}]}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:13.654690 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:14.635864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:16.407807 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] validate_networks() for [('b0311c2f-c020-471c-8a70-8d7130b50197', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:25:16.519679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] validate_networks() for [('e250d256-e01c-4e22-9b87-b8c02fd3002e', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:25:17.155982 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:25:17.156637 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:25:17.157789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:25:17.158351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:25:17.158990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:25:17.172491 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:17.173524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:17.173956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:17.174673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:17.175178 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:17.175649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:17.197173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Getting quotas for project 049e0892819c4a07b79c39737548839d. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:25:17.202767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Getting quotas for user 687fc77f37c54cd5a4503723ae59a082 and project 049e0892819c4a07b79c39737548839d. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:25:17.215411 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:25:17.217710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:25:17.251364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:25:17.251780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:25:17.252274 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:25:17.252852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:25:17.253440 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:25:17.257795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:17.263125 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:17.263608 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:17.264079 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:17.264972 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:17.265589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:17.266329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:17.288387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Getting quotas for project 526e4ff2ae594d54a53e628df8802a92. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:25:17.293882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Getting quotas for user 9b5890ee9a114299b0a15a6608503632 and project 526e4ff2ae594d54a53e628df8802a92. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:25:17.305329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:25:17.307908 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:25:17.546211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6fa1d2b8-7654-4405-8b40-58b0eb8fcafa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.489476 Aug 10 11:25:17.549422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f965904d-2d17-4980-a758-e561264d5389 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.907874 Aug 10 11:25:17.549904 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 143/306] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:25:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 5496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:25:17.565121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 164/307] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:25:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:25:17.583309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fe227868-4b48-4805-9875-f70f3f3c5d29 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:17.583937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fe227868-4b48-4805-9875-f70f3f3c5d29 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:17.588026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f2cd50dd-cbc7-43ee-a9fd-043d8f70408c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:17.590205 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f2cd50dd-cbc7-43ee-a9fd-043d8f70408c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:17.671127 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fe227868-4b48-4805-9875-f70f3f3c5d29 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:17.679723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fe227868-4b48-4805-9875-f70f3f3c5d29 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1246 microversion: 2.1 time: 0.124598 Aug 10 11:25:17.680732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 144/308] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:17 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:17.706435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f2cd50dd-cbc7-43ee-a9fd-043d8f70408c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:17.711657 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f2cd50dd-cbc7-43ee-a9fd-043d8f70408c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1219 microversion: 2.1 time: 0.150119 Aug 10 11:25:17.712267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 165/309] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:17 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:18.701741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d658ffe5-0791-47db-af1d-786484c1a9b1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:18.702423 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d658ffe5-0791-47db-af1d-786484c1a9b1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:18.735948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-664ecb71-d5c9-4cc0-b20f-fdb45549992e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:18.736684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-664ecb71-d5c9-4cc0-b20f-fdb45549992e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:18.763056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d658ffe5-0791-47db-af1d-786484c1a9b1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:18.770180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d658ffe5-0791-47db-af1d-786484c1a9b1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1246 microversion: 2.1 time: 0.072930 Aug 10 11:25:18.777293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 145/310] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:18 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:18.803583 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-664ecb71-d5c9-4cc0-b20f-fdb45549992e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:18.811543 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-664ecb71-d5c9-4cc0-b20f-fdb45549992e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1219 microversion: 2.1 time: 0.079387 Aug 10 11:25:18.812125 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 166/311] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:18 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:19.791197 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ec3c216a-4b56-4c3b-ba77-7d88abb33c50 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:19.792810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ec3c216a-4b56-4c3b-ba77-7d88abb33c50 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:19.832429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b938e8b4-4591-4e23-9c1b-05b5ca3c3c37 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:19.833080 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b938e8b4-4591-4e23-9c1b-05b5ca3c3c37 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:19.847898 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ec3c216a-4b56-4c3b-ba77-7d88abb33c50 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:19.855676 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ec3c216a-4b56-4c3b-ba77-7d88abb33c50 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1246 microversion: 2.1 time: 0.068142 Aug 10 11:25:19.856571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 146/312] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:19 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:19.888289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b938e8b4-4591-4e23-9c1b-05b5ca3c3c37 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:19.902715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b938e8b4-4591-4e23-9c1b-05b5ca3c3c37 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1219 microversion: 2.1 time: 0.073989 Aug 10 11:25:19.903263 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 167/313] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:19 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:20.877880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:20.878574 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:20.891321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:20.891831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:20.892310 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:20.893040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:20.893500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:20.893927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:20.894167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cb0adb42-5f2e-4bc5-8d43-414bb44419ab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Action: 'create', calling method: .version_select at 0x7f6f449beee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-257903232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGe8rNQZ3U87qC3t+MvHwU/0f5AiXbZlBsRHn5KtFcI17I/TZ9wyPjkA9b5NinQ1jsvCrjiADQnkyUWjcFlZTnERS7vDkDHs4hITczD7z8afY9cS4/L3MOO05t4nQrUIg=="}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:20.910555 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-cb0adb42-5f2e-4bc5-8d43-414bb44419ab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Getting quotas for project e202fe4250104681a9fe73fc4750c33f. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:25:20.914809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-cb0adb42-5f2e-4bc5-8d43-414bb44419ab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Getting quotas for user e49a2b5153b04661b3ef6fe699867005 and project e202fe4250104681a9fe73fc4750c33f. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:25:20.957625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:20.965802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5ed15684-67fb-4917-b66a-54209024e656 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1250 microversion: 2.1 time: 0.091783 Aug 10 11:25:20.966352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 147/314] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:20 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1250 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:20.971750 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b8f506af-5174-4ec4-8c1d-96610bdee131 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:20.972378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b8f506af-5174-4ec4-8c1d-96610bdee131 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:21.028383 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b8f506af-5174-4ec4-8c1d-96610bdee131 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:21.031534 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b8f506af-5174-4ec4-8c1d-96610bdee131 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1219 microversion: 2.1 time: 0.064259 Aug 10 11:25:21.032199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 148/315] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:20 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:21.059146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cb0adb42-5f2e-4bc5-8d43-414bb44419ab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.168730 Aug 10 11:25:21.059792 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 168/316] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:25:20 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:25:21.160403 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-116706718", "imageRef": "f74737c0-4659-4136-996b-6e8cd3359604", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-257903232", "networks": [{"uuid": "ee61172b-5f26-48b5-82bf-ed9e55a2530b"}]}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:21.211732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] validate_networks() for [('ee61172b-5f26-48b5-82bf-ed9e55a2530b', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:25:21.588752 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:25:21.589292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:25:21.589857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:25:21.590294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:25:21.590697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:25:21.599559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:21.600069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:21.600499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:21.601209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:21.601651 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:21.602066 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:21.619181 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Getting quotas for project e202fe4250104681a9fe73fc4750c33f. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:25:21.626869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Getting quotas for user e49a2b5153b04661b3ef6fe699867005 and project e202fe4250104681a9fe73fc4750c33f. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:25:21.635519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:25:21.638485 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f74737c0-4659-4136-996b-6e8cd3359604',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:25:21.956060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-75dd0609-77ba-44d8-924e-755fc8310b45 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799719 Aug 10 11:25:21.956726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 149/317] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:25:21.967216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5bf1c7b3-44ed-4da1-b926-26f0aced5aee tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:21.967833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5bf1c7b3-44ed-4da1-b926-26f0aced5aee tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:21.987407 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:21.988107 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:21.996081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:21.996834 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:21.997447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:21.998662 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:21.999340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:22.000053 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:22.029295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5bf1c7b3-44ed-4da1-b926-26f0aced5aee tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:22.037953 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5bf1c7b3-44ed-4da1-b926-26f0aced5aee tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1257 microversion: 2.1 time: 0.073159 Aug 10 11:25:22.038542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 169/318] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:21 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:22.055410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:22.056437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:22.063363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:22.063848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:22.064298 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:22.066026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:22.066026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:22.066026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:22.092169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:22.107482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-915d3e6b-bb27-4f29-a1df-965b8ddead4a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1250 microversion: 2.1 time: 0.124570 Aug 10 11:25:22.108336 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 150/319] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:21 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1250 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:22.130573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:22.138726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a6c69fc5-834f-459e-9989-6800a4e1db5a tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1223 microversion: 2.1 time: 0.089975 Aug 10 11:25:22.139354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 170/320] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:22 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:23.059839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7436873b-9671-4fc7-8888-c507dc60c901 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:23.060457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7436873b-9671-4fc7-8888-c507dc60c901 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:23.113866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7436873b-9671-4fc7-8888-c507dc60c901 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:23.121159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7436873b-9671-4fc7-8888-c507dc60c901 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1257 microversion: 2.1 time: 0.065502 Aug 10 11:25:23.121738 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 151/321] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:23 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:23.128545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:23.129226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:23.135223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:23.135643 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:23.136838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:23.137528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:23.137976 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:23.138397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:23.159915 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:23.162271 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:23.167885 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:23.168555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:23.169135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:23.169892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:23.170414 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:23.170921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:23.197636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:23.205480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-bb071662-2329-4d5f-be81-02c8b2f185c9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1250 microversion: 2.1 time: 0.080715 Aug 10 11:25:23.206053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 171/322] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:23 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1250 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:23.236762 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:23.244202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fe2abacd-adae-4e1d-b40e-fe22b13432db tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1223 microversion: 2.1 time: 0.088140 Aug 10 11:25:23.244756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 152/323] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:23 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:24.142289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:24.142877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:24.148796 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:24.149497 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:24.149925 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:24.150606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:24.151052 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:24.151558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:24.213027 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:24.221311 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a42a2649-ad9c-41a0-a504-f18632ae861c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1261 microversion: 2.1 time: 0.082895 Aug 10 11:25:24.221830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 172/324] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:24 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:24.226430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:24.227032 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:24.233838 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:24.234370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:24.234802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:24.235480 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:24.235927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:24.236367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:24.267059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:24.274046 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:24.274046 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:24.274452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:24.274883 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:24.275557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:24.276243 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:24.276797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:24.298604 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:24.305995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-61149dcd-a3dc-4477-92c3-6ee444cf82ac tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1298 microversion: 2.1 time: 0.083721 Aug 10 11:25:24.306613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 153/325] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:24 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:24.338078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:24.345695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fde907c6-bae5-4149-9ce8-5eeb8d5cc2a2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1271 microversion: 2.1 time: 0.083391 Aug 10 11:25:24.346259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 173/326] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:24 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:25.242158 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:25.243462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:25.250541 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:25.251043 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:25.251539 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:25.252329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:25.252845 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:25.253489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:25.319434 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:25.329692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7f733d58-6aee-44af-be9e-940bb6ac219d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1309 microversion: 2.1 time: 0.091337 Aug 10 11:25:25.343704 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 154/327] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:25 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:25.354691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:25.354691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:25.354691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:25.354691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:25.355938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:25.355938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:25.355938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:25.355938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:25.367159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:25.368138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:25.375322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:25.375920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:25.376503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:25.377461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:25.378120 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:25.378724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:25.424596 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:25.432480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7b42e002-cc8c-48a6-b6eb-cbfa1aa22860 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1316 microversion: 2.1 time: 0.106036 Aug 10 11:25:25.434127 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 174/328] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:25 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:25.451440 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:25.458725 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9370fc43-3f16-409c-a073-96c5a35d0f95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1279 microversion: 2.1 time: 0.095862 Aug 10 11:25:25.466516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 155/329] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:25 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:26.361496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:26.362412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:26.375482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:26.376073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:26.376577 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:26.377350 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:26.377879 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:26.378444 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:26.444869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:26.456409 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:26.457735 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:26.460424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b8fc8b64-6a39-4349-9b45-18776fb69acd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1317 microversion: 2.1 time: 0.101603 Aug 10 11:25:26.471715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 175/330] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:26 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1317 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:26.476663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:26.477282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:26.477809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:26.478763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:26.479381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:26.481707 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:26.488273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:26.488883 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:26.494973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:26.497563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:26.498048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:26.498478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:26.499230 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:26.499690 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:26.500950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:26.620136 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:26.628457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4b373225-b1ff-47f3-8136-0287f24a2b8c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1304 microversion: 2.1 time: 0.176148 Aug 10 11:25:26.629321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 156/331] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:26 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:26.733370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:26.741209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fc58fd11-7a28-4792-8c0a-c495a5ad0e8d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.257715 Aug 10 11:25:26.741779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 176/332] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:26 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:27.483848 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:27.486364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:27.492314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:27.492976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:27.493593 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:27.494479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:27.495165 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:27.496219 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:27.607948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:27.626580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8eb8ee4f-1633-4275-9bce-8bc8a7450374 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1315 microversion: 2.1 time: 0.147707 Aug 10 11:25:27.628538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 157/333] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:27 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:27.650814 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:27.654325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:27.656700 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:27.668271 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:27.668775 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:27.669716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:27.675559 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:27.678482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:27.679171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:27.764194 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:27.769410 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:27.776604 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:27.776809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:27.780452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:27.781186 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:27.781649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:27.782078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:27.970511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:27.982528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2dce0090-e27f-45c0-a28b-ca56d2f80d93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.336241 Aug 10 11:25:27.993773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 177/334] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:27 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:28.015321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:28.017938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-81a5d87c-3875-43f9-ac9c-62f106312ea8 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.259176 Aug 10 11:25:28.018491 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 158/335] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:27 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:28.098200 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-4d934cfa-1037-4c8e-a8b6-19dd0e1051b3 req-bcd19551-efe5-44db-beb5-b92d5fc37f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76385e9f-c2f0-4102-a711-2c59ab9864ac", "tag": "f5cb46a9-c2a3-45ee-9134-1e1c21f48e97"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:28.112941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-4d934cfa-1037-4c8e-a8b6-19dd0e1051b3 req-bcd19551-efe5-44db-beb5-b92d5fc37f54 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:28.112941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-4d934cfa-1037-4c8e-a8b6-19dd0e1051b3 req-bcd19551-efe5-44db-beb5-b92d5fc37f54 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:28.112941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-4d934cfa-1037-4c8e-a8b6-19dd0e1051b3 req-bcd19551-efe5-44db-beb5-b92d5fc37f54 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:28.141805 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-4d934cfa-1037-4c8e-a8b6-19dd0e1051b3 req-bcd19551-efe5-44db-beb5-b92d5fc37f54 service nova] Creating event network-changed:f5cb46a9-c2a3-45ee-9134-1e1c21f48e97 for instance 76385e9f-c2f0-4102-a711-2c59ab9864ac on hv-cinder-85061 Aug 10 11:25:28.148031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-4d934cfa-1037-4c8e-a8b6-19dd0e1051b3 req-bcd19551-efe5-44db-beb5-b92d5fc37f54 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053772 Aug 10 11:25:28.153977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 178/336] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:28.660588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:28.661127 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:28.668643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:28.669126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:28.669551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:28.670307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:28.670850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:28.671182 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:28.816978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:28.828633 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bc21875a-4e49-4fed-baa7-940e6fd690e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.171740 Aug 10 11:25:28.829759 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 159/337] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:28 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:29.006625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:29.007958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:29.016290 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:29.017088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:29.017711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:29.018609 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:29.019254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:29.019859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:29.039193 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:29.039802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:29.046952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:29.047634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:29.048108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:29.048825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:29.049284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:29.049711 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:29.220541 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:29.229014 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dd31026f-5e30-4c42-b80f-7118cc473612 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.227214 Aug 10 11:25:29.237516 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 179/338] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:29 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:29.243421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:29.251239 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c0bbd482-c4d1-43be-8f6d-fa0b434a3fbe tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.216156 Aug 10 11:25:29.251985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 160/339] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:29 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:29.855268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:29.856191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:29.862755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:29.863378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:29.863937 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:29.864758 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:29.865279 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:29.865755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:30.011519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:30.018972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a12c06d8-49d0-4bb0-8789-073fbf3fd43d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.172372 Aug 10 11:25:30.019544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 180/340] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:29 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:30.164394 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-12ef9092-e2dc-40af-aea7-d09250f89ce9 req-40a343c7-eef1-4f2a-9c95-f362fcc78f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f999fcc-0926-4db9-9acc-218a002e1ae4", "tag": "c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:30.174909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-12ef9092-e2dc-40af-aea7-d09250f89ce9 req-40a343c7-eef1-4f2a-9c95-f362fcc78f24 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:30.175426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-12ef9092-e2dc-40af-aea7-d09250f89ce9 req-40a343c7-eef1-4f2a-9c95-f362fcc78f24 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:30.175857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-12ef9092-e2dc-40af-aea7-d09250f89ce9 req-40a343c7-eef1-4f2a-9c95-f362fcc78f24 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:30.189817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-12ef9092-e2dc-40af-aea7-d09250f89ce9 req-40a343c7-eef1-4f2a-9c95-f362fcc78f24 service nova] Creating event network-changed:c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5 for instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 on hv-cinder-85061 Aug 10 11:25:30.195265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-12ef9092-e2dc-40af-aea7-d09250f89ce9 req-40a343c7-eef1-4f2a-9c95-f362fcc78f24 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034507 Aug 10 11:25:30.196049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 161/341] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:30.250861 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:30.251461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:30.257500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:30.258207 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:30.258795 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:30.259641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:30.260293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:30.260983 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:30.274682 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:30.275709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:30.287259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:30.288236 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:30.288930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:30.289739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:30.290201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:30.290632 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:30.472856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:30.478258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:30.480457 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-13441519-7778-409a-974e-79d277ff8982 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.233239 Aug 10 11:25:30.481050 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 181/342] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:30 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:30.486039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f36db36a-5071-4faa-af3f-9242d91d98f7 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.216376 Aug 10 11:25:30.486669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 162/343] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:30 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:31.040432 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:31.041136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:31.048356 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:31.048844 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:31.049277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:31.049984 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:31.050444 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:31.051775 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:31.504057 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:31.505318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:31.513950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:31.514698 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:31.515305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:31.516347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:31.517268 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:31.517871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:31.610602 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=4 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:31.954221 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:31.962898 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8cc53ce4-efcc-4640-b9f9-11eba6c42dda tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.463504 Aug 10 11:25:31.963699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 163/344] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:31 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:31.969720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:31.972794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:31.982935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:31.985520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:31.985520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:31.985520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:31.989626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:31.989626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:32.033599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=22 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:32.046786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:32.060043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-982961c1-791e-4be3-80e4-cf362b1a984d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 1.019853 Aug 10 11:25:32.060043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 182/345] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:31 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:32.186064 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:32.193764 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9684ae4a-560c-416a-a328-844dabff7ded tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.228614 Aug 10 11:25:32.194508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 164/346] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:31 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:32.991866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:32.992720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:32.999717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:33.000255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:33.000692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:33.001386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:33.001834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:33.002268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:33.081476 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:33.083821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:33.100148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:33.102547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:33.102883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:33.104768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:33.105992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:33.106505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:33.126899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=22 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:33.209035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:33.223790 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-76f78bb4-597e-4919-be1f-a9ff95c448b6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.235428 Aug 10 11:25:33.236255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 183/347] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:32 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:33.238373 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:33.238373 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:33.246137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:33.247506 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:33.248146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:33.249315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:33.250035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:33.250633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:33.331248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:33.338647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d605050f-697e-44af-8530-f52807aa2c38 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.264054 Aug 10 11:25:33.340314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 165/348] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:33 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:33.412293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:33.420399 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-56873246-8f96-4661-821a-f0ed457ef7f2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.194935 Aug 10 11:25:33.421187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 184/349] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:33 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:34.246993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:34.247636 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:34.266291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:34.266769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:34.267435 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:34.267959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:34.268489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:34.269115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:34.288862 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:34.359355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:34.359971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:34.369096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:34.369604 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:34.370038 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:34.371387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:34.371839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:34.372294 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:34.477035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:34.484980 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1fbcf1bd-0a9b-4e07-b712-393753d97f38 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.242720 Aug 10 11:25:34.485746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 166/350] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:34 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:34.496252 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:34.496868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:34.502715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:34.503198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:34.503629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:34.504484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:34.504937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:34.505359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:34.543151 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:34.555634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-70718315-5f9f-433b-9660-67dd8a83749b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.195745 Aug 10 11:25:34.555634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 185/351] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:34 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:34.654348 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:34.661554 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7da56124-8f9f-4406-b316-5f9bb614b9e3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.169149 Aug 10 11:25:34.662115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 167/352] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:34 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:35.505159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:35.505788 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:35.512046 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:35.516303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:35.516303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:35.516303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:35.516303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:35.516682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:35.577407 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:35.579486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:35.589916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:35.599852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:35.600613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:35.601520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:35.602322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:35.602971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:35.710635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:35.716159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:35.721855 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8e9b404e-b9b7-4259-9782-bbf981468086 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.220499 Aug 10 11:25:35.732077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 186/353] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:35 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:35.732077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:35.732077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:35.737609 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:35.754431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:35.754431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:35.754431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:35.754431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:35.755012 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:35.816670 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:35.824159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e0ef577a-8078-45cf-9dea-2dc59eb84fe1 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.253578 Aug 10 11:25:35.824726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 168/354] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:35 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:35.920628 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:35.928778 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c3171dc9-8829-4024-a90b-efc1a6d9b1e1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.204652 Aug 10 11:25:35.929356 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 187/355] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:35 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:36.743699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:36.744408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:36.755582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.756105 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.756543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.757239 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.757721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.758148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.845399 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:36.846165 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:36.852129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.852605 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.853207 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.854106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.855248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.855711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.944035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:36.956801 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3aa9f8da-7e05-4408-acfb-16283c78cf7f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.216923 Aug 10 11:25:36.969214 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 169/356] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:36 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:36.978847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:36.980032 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:36.988362 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.988915 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.989285 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:36.989992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:36.997944 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:36.997944 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:37.092885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:37.106467 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-17a01d97-4ad5-4049-840a-462d3389e393 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.262470 Aug 10 11:25:37.120673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 188/357] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:36 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:37.157883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:37.165674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-aa1a56f2-123d-40e0-92d8-903ad1bc3c71 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.192009 Aug 10 11:25:37.166233 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 170/358] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:36 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:37.982175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:37.983611 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:37.991355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:37.992384 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:37.993062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:37.994012 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:37.995717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:37.996627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.139689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:38.139689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:38.139689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:38.139689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:38.140668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.141770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:38.142448 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:38.143412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.243905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:38.252483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7d0c9769-95e2-413f-9d0f-bc71bebba346 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.274285 Aug 10 11:25:38.264623 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 189/359] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:37 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:38.269822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:38.271315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:38.277777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:38.278332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:38.278851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.279626 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:38.280193 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:38.280709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:38.411289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:38.419266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0c4baf0e-7885-43d8-9c2a-598bde99e6a3 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.295679 Aug 10 11:25:38.420086 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 171/360] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:38 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:38.468395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:38.476529 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d3063a79-0ff9-4a17-94e7-5e249afe3a56 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.210443 Aug 10 11:25:38.477128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 190/361] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:38 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:38.647861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1663198924", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-437234834", "security_groups": [{"name": "tempest-secgroup-smoke-1366672668"}], "networks": [{"uuid": "a99b29bc-0c92-44ec-a6ba-fb557d4f28a0"}], "block_device_mapping_v2": [{"uuid": "3b6e64c0-7f82-40be-ae21-974bad6362c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:38.777218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] validate_networks() for [('a99b29bc-0c92-44ec-a6ba-fb557d4f28a0', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:25:39.195945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:25:39.196582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:25:39.196896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:25:39.197285 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:25:39.197863 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:25:39.209910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:39.217547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.218296 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.218740 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.219454 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.219938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.220502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.240205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Getting quotas for project e05759c8ab0248e58d35630a611912f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:25:39.244439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Getting quotas for user 46dffe5f71cf4d2ca7bf42f86d2bb07a and project e05759c8ab0248e58d35630a611912f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:25:39.278532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:39.279141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:39.286499 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.287213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.287454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.288182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.288632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.289055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.311128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:25:39.315067 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b6e64c0-7f82-40be-ae21-974bad6362c0',volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:25:39.437418 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:39.444900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-81d0b8b2-1020-469e-b1fc-435ad097cbfc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.170949 Aug 10 11:25:39.445461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 191/362] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:39 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:39.457773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:39.458376 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:39.464868 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.465199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.465630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.466314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.466763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.467182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.738562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:39.746159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-07a04426-2995-4a7c-84ba-7d4c1ace8867 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.291970 Aug 10 11:25:39.746756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 192/363] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:39 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:39.751520 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:39.752151 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:39.757852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.758336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.758768 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.759449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:39.759895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:39.760363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:39.894842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:39.903240 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c91bb4e4-22f6-4406-bde9-038b370c67de tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.155452 Aug 10 11:25:39.903790 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 193/364] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:39 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:40.142827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-91ba97bc-e0c3-4ada-9aca-03f69e842434 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.498909 Aug 10 11:25:40.143658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 172/365] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:25:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:25:40.154190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-500d1d1c-2921-44f6-bf26-15c7ced4a60e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:40.154784 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-500d1d1c-2921-44f6-bf26-15c7ced4a60e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:40.213844 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-500d1d1c-2921-44f6-bf26-15c7ced4a60e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:40.221672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-500d1d1c-2921-44f6-bf26-15c7ced4a60e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1088 microversion: 2.1 time: 0.071241 Aug 10 11:25:40.224088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 194/366] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:40 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:40.466570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:40.467208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:40.473389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.473873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.474313 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.475003 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.475456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.475910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.619432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:40.627979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-11fc7f9d-40b8-4953-8e52-b416162fcd57 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.165483 Aug 10 11:25:40.628574 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 173/367] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:40 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:40.767362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:40.776919 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:40.776919 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.776919 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.776919 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.777706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.777706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.777706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.908672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:40.915940 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-902ef3ea-a93e-4eb3-9afe-47e279d44763 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.152499 Aug 10 11:25:40.916535 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 195/368] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:40 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:40.925197 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:40.925948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:40.934241 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.935577 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.936917 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:40.937251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:40.937683 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:40.938116 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:41.075001 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:41.082806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d51bc11c-6ef1-49bd-b82e-c4b58d32f00d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.162210 Aug 10 11:25:41.085587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 174/369] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:40 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:41.242839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e7d1f817-9e5a-4a7b-9d11-bbae3ef3aba6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:41.243428 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e7d1f817-9e5a-4a7b-9d11-bbae3ef3aba6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:41.297229 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e7d1f817-9e5a-4a7b-9d11-bbae3ef3aba6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:41.303872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e7d1f817-9e5a-4a7b-9d11-bbae3ef3aba6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1088 microversion: 2.1 time: 0.065058 Aug 10 11:25:41.304480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 196/370] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:41 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:41.648491 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:41.649096 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:41.656374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:41.656855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:41.657284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:41.657967 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:41.658416 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:41.658839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:41.795340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:41.802744 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b43c3dd4-b06e-4c7b-bedc-a5ce7aef17be tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.158138 Aug 10 11:25:41.803311 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 175/371] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:41 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:41.937352 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:41.937970 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:41.943935 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:41.944448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:41.944880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:41.945566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:41.946014 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:41.946437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.081954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:42.090895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e42264f4-cd77-4f0d-9f99-3ba064a2a878 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.157286 Aug 10 11:25:42.091458 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 197/372] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:41 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:42.103859 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:42.104568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:42.110398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:42.110874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:42.111304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.111987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:42.112478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:42.112899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.245508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:42.253059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c256d130-c42a-485a-abbf-9f814147c40e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.152998 Aug 10 11:25:42.253623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 176/373] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:42 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:42.325155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:42.325762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:42.331982 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:42.332876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:42.333314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.334103 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:42.334474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:42.334962 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.399412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:42.407300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-872bd4bd-593e-40aa-ba28-9828f8b9b57c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1138 microversion: 2.1 time: 0.086509 Aug 10 11:25:42.407849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 198/374] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:42 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:42.823952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:42.824622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:42.831650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:42.832169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:42.833178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.833372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:42.833829 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:42.834254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:42.969655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:42.977080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-42711449-c1b5-4087-9b90-13345b90a1a4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.157480 Aug 10 11:25:42.977638 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 177/375] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:42 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:43.111602 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:43.120028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:43.120028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:43.120028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:43.120028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:43.120587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:43.120725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:43.121222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:43.251803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:43.260635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e7c2b5e7-767b-44e0-a473-8138d536b78e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.152776 Aug 10 11:25:43.261222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 199/376] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:43 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:43.308852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:43.308852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:43.308852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:43.308852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:43.309258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:43.309258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:43.309258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:43.309258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:43.424709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:43.426872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:43.427623 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:43.433657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e2348a34-0cd0-4940-87af-a9c1de9fda7b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.163079 Aug 10 11:25:43.434322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 178/377] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:43 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:43.434904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:43.435392 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:43.435818 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:43.436549 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:43.437023 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:43.437529 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:43.501548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:43.511261 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-051862ea-94ba-4b16-ad0a-be60db472708 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1138 microversion: 2.1 time: 0.086121 Aug 10 11:25:43.511261 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 200/378] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:43 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:43.999509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:44.000104 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:44.006446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.006927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.007358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.008063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.008559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.008972 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.142893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:44.150323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-703995d4-4744-4a28-b866-0674652e8a81 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.155397 Aug 10 11:25:44.150879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 179/379] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:43 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:44.281571 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:44.282127 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:44.288324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.289029 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.289496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.290483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.290941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.291367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.457417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:44.458956 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:44.473706 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.474208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.474642 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.476577 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.480248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.480907 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.570834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:44.584633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0fcd9d2d-f4fe-40ef-b681-2cf958ac1909 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.307592 Aug 10 11:25:44.586586 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 201/380] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:44 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:44.593541 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:44.594502 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:44.625560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.625560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.625560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.625560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:44.625902 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:44.625902 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:44.752582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:44.756130 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:44.764139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5a91ff75-03e1-4e9a-bd26-3cdb48987d38 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.313007 Aug 10 11:25:44.765732 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f391a478-b5b7-4458-9829-2a2a5be6315d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1138 microversion: 2.1 time: 0.177427 Aug 10 11:25:44.765976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 180/381] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:44 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:44.766427 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 202/382] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:44 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1138 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:45.171353 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:45.171970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:45.179088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:45.182700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:45.187279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:45.187279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:45.187279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:45.188306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:45.326595 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:45.334277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-249a3105-1561-4270-a859-6d19a1360eb3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.167439 Aug 10 11:25:45.334845 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 181/383] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:45 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:45.470726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-7c0dad41-5d17-4085-8b91-d5b5b949006e req-9ba290ce-e755-4cf8-8acd-41388937df5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34add072-ed4f-4601-b02e-e5b98edbb970", "tag": "fb19c135-b6e1-4aab-9034-c28ae9b55761"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:45.483254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7c0dad41-5d17-4085-8b91-d5b5b949006e req-9ba290ce-e755-4cf8-8acd-41388937df5a service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:45.483965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7c0dad41-5d17-4085-8b91-d5b5b949006e req-9ba290ce-e755-4cf8-8acd-41388937df5a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:45.484588 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7c0dad41-5d17-4085-8b91-d5b5b949006e req-9ba290ce-e755-4cf8-8acd-41388937df5a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:45.497880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-7c0dad41-5d17-4085-8b91-d5b5b949006e req-9ba290ce-e755-4cf8-8acd-41388937df5a service nova] Creating event network-changed:fb19c135-b6e1-4aab-9034-c28ae9b55761 for instance 34add072-ed4f-4601-b02e-e5b98edbb970 on hv-cinder-85061 Aug 10 11:25:45.505365 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-7c0dad41-5d17-4085-8b91-d5b5b949006e req-9ba290ce-e755-4cf8-8acd-41388937df5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038189 Aug 10 11:25:45.506466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 203/384] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:25:45.610894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:45.611689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:45.631166 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:45.632061 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:45.632789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:45.633882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:45.634407 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:45.635037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:45.787593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:45.792372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:45.795115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:45.795556 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:45.795986 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:45.796918 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:45.797709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:45.798133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:46.103379 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:46.120850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2fe121cd-4221-42ae-bf0e-c16d42cbeac2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1186 microversion: 2.1 time: 0.337749 Aug 10 11:25:46.123190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 204/385] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:45 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1186 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:46.130149 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:46.138816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-968ce4d1-550f-486f-bcd3-e3e54918b924 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.534330 Aug 10 11:25:46.139596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 182/386] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:45 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:46.141891 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:46.151673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:46.151673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:46.151673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:46.151673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:46.152226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:46.152226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:46.152226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:46.345810 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:46.355243 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-684cc22a-f0f8-4843-9c19-56090d2dc3d1 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.229475 Aug 10 11:25:46.355421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 205/387] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:46 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:46.358100 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:46.358719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:46.365232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:46.365923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:46.366779 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:46.367644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:46.368323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:46.368909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:46.546271 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:46.549663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:46.553873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2f9b8d34-1398-4e91-b44a-2fbb6a95e042 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.201474 Aug 10 11:25:46.554439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 183/388] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:46 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:47.143683 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:47.144378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:47.150924 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.152156 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.152604 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.153316 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.153764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.154199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.158612 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:47.171317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:47.174243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:47.178088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.178564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.178992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.179669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.180140 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.180560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.218571 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:47.226373 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8b567307-afc5-49c3-94b4-aab06d25340f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1194 microversion: 2.1 time: 0.087452 Aug 10 11:25:47.227044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 206/389] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:47 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:47.315879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:47.324101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7cc74aaf-cb91-4199-9ff7-61df6b149d14 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.156925 Aug 10 11:25:47.329469 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 184/390] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:47 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:47.378236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:47.378883 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:47.385257 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.386548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.387211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.388517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.388685 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.389056 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.517472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:47.524774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2ed42478-b68d-4428-a607-107445ae737b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.150433 Aug 10 11:25:47.525359 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 207/391] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:47 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:47.575100 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:47.575705 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:47.582417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.582895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.583328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.584077 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:47.584529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:47.584952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:47.721178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:47.728513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-174fd673-8baa-4f40-a5b7-9b34b23ab1ee tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.157972 Aug 10 11:25:47.729073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 185/392] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:47 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:48.248680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:48.249312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:48.255199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.255680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.256162 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.256846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.257296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.257716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.320333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:48.328673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1d9479e7-6b13-4437-9706-686d26d03b72 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1194 microversion: 2.1 time: 0.084384 Aug 10 11:25:48.329234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 208/393] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:48 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:48.345726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:48.346340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:48.352531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.353018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.353456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.354135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.354614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.355124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.483757 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:48.491148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6da85a12-ef79-4860-b4cc-816d6dee1863 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.149424 Aug 10 11:25:48.491713 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 186/394] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:48 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:48.545272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:48.545875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:48.551786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.552291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.552727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.553408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.553856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.554277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.681780 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:48.689953 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3539788f-af25-4092-b9e3-b5231e21dc0f tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.148441 Aug 10 11:25:48.690515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 209/395] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:48 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:48.750523 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:48.753359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:48.757435 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.757918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.758348 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.759030 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:48.759493 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:48.759881 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:48.892094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:48.900261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f2437915-b3c4-490b-b604-430398262ee6 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.153577 Aug 10 11:25:48.900826 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 187/396] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:48 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:49.347876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:49.348510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:49.355383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.355865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.356324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.357016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.357474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.357900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.431190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:49.439751 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-33fbceae-4085-4828-b357-fe33fe5ba920 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1194 microversion: 2.1 time: 0.095646 Aug 10 11:25:49.440430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 210/397] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:49 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:49.513216 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:49.513732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:49.515783 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:49.516446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=6 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:49.521424 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.521963 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.522398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.523122 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.523569 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.523990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.664030 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:49.671538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7ec23db5-2805-4341-9c14-6feefdd2314c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.162955 Aug 10 11:25:49.672155 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 188/398] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:49 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:49.710501 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:49.711107 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:49.718067 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.718549 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.718978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.719662 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.720136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.720554 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.858616 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:49.867627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-241cd78a-8b73-4586-a02e-42a62d474e1c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.160878 Aug 10 11:25:49.868240 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 211/399] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:49 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:49.922003 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:49.922607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:49.928958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.929433 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.929877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:49.930537 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:49.930983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:49.931398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:50.064709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:50.072215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-40e3dfda-6d89-49b1-9e92-35ce1bc30c5e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.153976 Aug 10 11:25:50.072832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 189/400] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:49 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:50.461125 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:50.461756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:50.468335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:50.468812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:50.469235 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:50.469927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:50.470386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:50.470793 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:50.537374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:50.545875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fbf7377d-2006-4694-b6c1-4403f07fd210 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1194 microversion: 2.1 time: 0.088572 Aug 10 11:25:50.546471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 212/401] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:50 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:50.692607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:50.693147 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:50.699340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:50.699864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:50.700373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:50.701058 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:50.701785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:50.702205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:50.835352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:50.843692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-52503497-8921-4794-8edf-a331f225bec4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.155655 Aug 10 11:25:50.844310 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 190/402] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:50 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:50.889463 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:50.890072 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:50.895884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:50.896411 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:50.896830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:50.897510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:50.897957 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:50.898378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:51.033607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:51.040888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-df67390c-dbd9-4512-8943-fd95c1dca95d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.155937 Aug 10 11:25:51.041447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 213/403] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:50 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:51.095190 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:51.095793 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:51.102361 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:51.102668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:51.103105 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:51.103788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:51.104326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:51.104937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:51.234729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:51.242315 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-73ec09e7-bde4-4889-9d30-f96ecf11c743 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.150910 Aug 10 11:25:51.242866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 191/404] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:51 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:51.566607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:51.567307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:51.569247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:51.575168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:51.575720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:51.576442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:51.577135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:51.577574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:51.578016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:51.640105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:51.647737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-176e238f-122d-4075-bd3c-1f1bb6366af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1204 microversion: 2.1 time: 0.085012 Aug 10 11:25:51.648450 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 214/405] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:51 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:51.865157 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:51.865789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:51.872966 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:51.873443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:51.873868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:51.874546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:51.874991 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:51.875410 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.004748 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:52.012610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-37912f64-64c8-40b3-8de1-d62ddcdd96e4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.151179 Aug 10 11:25:52.015922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 192/406] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:51 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:52.061606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:52.062352 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:52.068849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:52.069411 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:52.069944 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.070698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:52.071221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:52.071709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.205525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:52.212880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1a067b8b-5cfb-4b10-b528-2d76d7c7f4b4 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.155133 Aug 10 11:25:52.213439 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 215/407] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:52 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:52.268938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:52.268938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:52.269565 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:52.269879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:52.270317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.271004 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:52.271454 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:52.271875 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.404690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:52.412106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6c2155d4-ac86-4b4f-8716-9ccca77c0f60 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.153138 Aug 10 11:25:52.412668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 193/408] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:52 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:52.668493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:52.669132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:52.675731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:52.676246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:52.676681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.677414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:52.677872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:52.678337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:52.746155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:52.753504 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fef2773f-908b-44bf-8774-84b2dbbe32d4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1204 microversion: 2.1 time: 0.088980 Aug 10 11:25:52.754072 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 216/409] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:52 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:53.033718 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:53.034633 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:53.041226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.041713 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.042237 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.042858 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.043303 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.043721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.171796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:53.179183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ceb6862e-8bfb-4c35-8c9c-810231c4dd6f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.149713 Aug 10 11:25:53.179738 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 194/410] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:53 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:53.234517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:53.235127 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:53.241086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.241563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.241990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.242672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.243119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.243538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.374484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:53.382011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-26e78039-a47e-4df7-9e9f-de0db5e27160 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.151313 Aug 10 11:25:53.382583 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 217/411] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:53 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:53.393496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:53.394008 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:53.399958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.400498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.400935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.401657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.402083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.402508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.425373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c93e737a-2c51-476f-9279-24779d7c912a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/ips" status: 200 len: 150 microversion: 2.20 time: 0.035675 Aug 10 11:25:53.425937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 195/412] 10.222.0.13 () {60 vars in 1289 bytes} [Wed Aug 10 11:25:53 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:25:53.432250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:53.433996 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:53.440189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.440676 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.441100 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.441779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.442222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.442666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.581388 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:53.589709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f60148f9-bdb3-4472-a9a4-4e924ead54f1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.161265 Aug 10 11:25:53.592330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 218/413] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:53 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:53.774472 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:53.775034 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:53.781570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.782016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.782447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.783127 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:53.783577 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:53.784017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:53.844412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:53.851815 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e18b36ef-15e8-4a39-b8cd-3732ed0c15ad tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1204 microversion: 2.1 time: 0.081320 Aug 10 11:25:53.852409 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 196/414] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:53 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1204 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:54.200495 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:54.201160 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:54.207496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.207981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.208446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.209198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.209649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.210071 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.235876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-3425844a-0c71-421f-aae1-6cce4fcb6b27 req-5a564141-6876-49fa-82c1-a3eb1080780a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76385e9f-c2f0-4102-a711-2c59ab9864ac", "name": "network-vif-plugged", "status": "completed", "tag": "f5cb46a9-c2a3-45ee-9134-1e1c21f48e97"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:54.246964 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-3425844a-0c71-421f-aae1-6cce4fcb6b27 req-5a564141-6876-49fa-82c1-a3eb1080780a service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.247472 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-3425844a-0c71-421f-aae1-6cce4fcb6b27 req-5a564141-6876-49fa-82c1-a3eb1080780a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.247898 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-3425844a-0c71-421f-aae1-6cce4fcb6b27 req-5a564141-6876-49fa-82c1-a3eb1080780a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.259305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-3425844a-0c71-421f-aae1-6cce4fcb6b27 req-5a564141-6876-49fa-82c1-a3eb1080780a service nova] Creating event network-vif-plugged:f5cb46a9-c2a3-45ee-9134-1e1c21f48e97 for instance 76385e9f-c2f0-4102-a711-2c59ab9864ac on hv-cinder-85061 Aug 10 11:25:54.265060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-3425844a-0c71-421f-aae1-6cce4fcb6b27 req-5a564141-6876-49fa-82c1-a3eb1080780a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033180 Aug 10 11:25:54.265643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 197/415] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:25:54.343763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:54.351341 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9e662b71-0b18-444f-88d5-eee865115578 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.155349 Aug 10 11:25:54.353900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 219/416] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:54 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:54.403510 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:54.404238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:54.410363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.410887 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.411324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.412030 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.412489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.412922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.588450 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:54.596119 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9cda066d-3b86-42f3-a6b1-411ce5a11a41 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.196935 Aug 10 11:25:54.596681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 198/417] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:54 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:54.609255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:54.609863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:54.615717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.616231 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.616653 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.617323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.617767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.618184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.756869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:54.764846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7735da25-67ae-4bab-b600-490304372f3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.159362 Aug 10 11:25:54.765407 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 220/418] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:54 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:54.873828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:54.874431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:54.882019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.882019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.882019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.882503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:54.882949 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:54.883369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:54.947184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:54.955089 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5d25d580-9cc7-428a-bfeb-ba3b353102db tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1204 microversion: 2.1 time: 0.086186 Aug 10 11:25:54.955648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 199/419] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:54 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1204 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:55.372783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:55.374482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:55.380304 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.381083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.381580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.382357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.382909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.383387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.583289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:55.592302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-88005e1b-e5ed-4802-939c-75717b94c037 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.224072 Aug 10 11:25:55.593331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 221/420] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:55 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:55.617147 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:55.629178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:55.629178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.629178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.629178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.629596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.629596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.629596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.774476 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:55.784659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f4f0570b-a34b-469a-93f9-3705c84b65e6 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.171218 Aug 10 11:25:55.785570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 200/421] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:55 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:55.786026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:55.788701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:55.796561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.797397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.798051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.802927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.803757 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.804303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.978247 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:55.979902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:55.981710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:55.986131 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:55.986480 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.986970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.987438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.988169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:55.988651 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:55.989265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:55.992770 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dfcac706-1031-4c28-833c-e96b0c68e9aa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.210291 Aug 10 11:25:55.994079 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 222/422] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:55 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:56.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:56.166191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:56.174434 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b9021970-8ab3-46c2-b269-142ec916ac63 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1272 microversion: 2.1 time: 0.201810 Aug 10 11:25:56.175155 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 201/423] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:55 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:56.613860 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:56.614467 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:56.620461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:56.621128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:56.621564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:56.622252 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:56.622698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:56.623119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:56.756965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:56.764520 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d7d1695f-c6b8-4756-a64d-24b51f105ac5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.154587 Aug 10 11:25:56.765076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 223/424] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:56 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:56.808966 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:56.809624 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:56.816362 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:56.816870 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:56.817309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:56.818000 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:56.818456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:56.818880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:56.952621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:56.959953 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-496079e5-6c4f-4cbc-9871-801a6ea99279 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.156013 Aug 10 11:25:56.960541 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 202/425] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:56 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:57.014601 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:57.015202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:57.017068 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:25:57.022090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.022255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.022557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.023236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.023678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.024434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.156610 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:57.164072 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b0b94064-a74b-4e49-be4d-8cf9118de746 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.154230 Aug 10 11:25:57.164635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 224/426] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:57 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:57.199572 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:57.200244 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:57.206439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.206925 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.207355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.208063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.208513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.208936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.254097 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:25:57.254741 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:57.261433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.262059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.262563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.263321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.263847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.264359 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.286870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lazy-loading 'flavor' on Instance uuid fcf17719-c01d-4bcc-8a23-83d1a8a1a492 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:25:57.344336 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:57.351870 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d4b8eb78-91d7-4c79-bc09-7e2a6501bda2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1272 microversion: 2.1 time: 0.157106 Aug 10 11:25:57.352494 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 203/427] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:57 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:57.786099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:57.786579 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:57.793789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.794253 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.794681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.795482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.795933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.796440 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.931689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:57.939836 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4e169c7d-b7d1-4574-ab69-bbffdf14999d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.157633 Aug 10 11:25:57.946721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 204/428] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:57 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:57.982907 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:57.983514 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:57.989473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.994451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.994451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:57.994451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:57.994451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:57.994962 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.039743 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-deff7e7c-58a6-4cb1-ad75-3eb8202f9c07 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/action" status: 202 len: 0 microversion: 2.20 time: 0.789513 Aug 10 11:25:58.040592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 225/429] 10.222.0.13 () {62 vars in 1319 bytes} [Wed Aug 10 11:25:57 2022] POST /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:25:58.049900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:58.050592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:58.056850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.057347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.057782 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.058567 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.059018 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.063406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.168415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:58.177179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-846376cf-aa51-40a8-a938-2d79c059446b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.199351 Aug 10 11:25:58.190486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 205/430] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:57 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:25:58.195270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:58.195878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:58.202173 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.202657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.203094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.203784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.204262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.204691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.218677 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:58.226847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:58.228462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:58.230813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7dd8400d-b661-406f-8110-3e8f9ac664bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.183991 Aug 10 11:25:58.231375 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 226/431] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:25:58 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:25:58.333811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:58.342387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7bbce915-7234-401d-bba3-ea03e1595f12 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.150841 Aug 10 11:25:58.342938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 206/432] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:58 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:58.372410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:58.373026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:58.379031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.379510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.379965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.380701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.381180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.381605 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.514775 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:58.522205 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-707d5c98-6124-4741-a732-c58eeac44969 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1272 microversion: 2.1 time: 0.153900 Aug 10 11:25:58.522772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 227/433] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:58 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:58.960933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:58.961544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:58.968633 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.969113 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.969546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:58.970229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:58.970677 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:58.971098 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.105614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.119107 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e948c635-68ea-4f2c-a649-d59599bc02bd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.155951 Aug 10 11:25:59.119107 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 207/434] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:58 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:59.197408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:59.198698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:59.209354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.209836 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.210266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.210999 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.211395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.211812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.255804 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:59.256701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:59.263143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.263896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.264276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.265039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.265583 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.266009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.405006 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.412522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-04d236ff-e632-487e-a837-b2ebcd7eb0e5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.218898 Aug 10 11:25:59.413083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 228/435] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:59 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:59.417500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:59.418103 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:59.423786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.424560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.424748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.425425 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.425877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.426301 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.431901 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.440164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.441742 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.442892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-06e6b006-4885-4a2b-ac4f-f4b2a771b92a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.192598 Aug 10 11:25:59.443458 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 208/436] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:25:59 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:25:59.544123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:25:59.544893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:25:59.550931 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.551493 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.552112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.552871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:25:59.553392 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:25:59.553884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:25:59.562206 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.569652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0144144a-1a8c-4cf0-9f29-1f8a6d557c5b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.155629 Aug 10 11:25:59.570215 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 229/437] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:59 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:25:59.687538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:25:59.694940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7a16e0ab-35a0-40e3-8365-83ee8bf6e560 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1272 microversion: 2.1 time: 0.155430 Aug 10 11:25:59.695499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 209/438] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:25:59 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:00.134070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.134684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.140599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.141107 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.141524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.142216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.142668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.143097 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.166034 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-0d76926b-cf71-4dd9-a2fd-fed9e852b3c1 req-8741b777-1f68-4f4d-b12d-a37c3c656641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f999fcc-0926-4db9-9acc-218a002e1ae4", "name": "network-vif-plugged", "status": "completed", "tag": "c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:00.177304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0d76926b-cf71-4dd9-a2fd-fed9e852b3c1 req-8741b777-1f68-4f4d-b12d-a37c3c656641 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.178010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0d76926b-cf71-4dd9-a2fd-fed9e852b3c1 req-8741b777-1f68-4f4d-b12d-a37c3c656641 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.178652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0d76926b-cf71-4dd9-a2fd-fed9e852b3c1 req-8741b777-1f68-4f4d-b12d-a37c3c656641 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.190987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-0d76926b-cf71-4dd9-a2fd-fed9e852b3c1 req-8741b777-1f68-4f4d-b12d-a37c3c656641 service nova] Creating event network-vif-plugged:c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5 for instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 on hv-cinder-85061 Aug 10 11:26:00.196195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-0d76926b-cf71-4dd9-a2fd-fed9e852b3c1 req-8741b777-1f68-4f4d-b12d-a37c3c656641 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Aug 10 11:26:00.196860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 210/439] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:00.275098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.283213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3ce8e57c-5205-4c9f-9056-ae979c0457c5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.153340 Aug 10 11:26:00.283774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 230/440] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:00 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:00.434425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.440780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.441199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.441657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.442089 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.442763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.443205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.443620 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.467511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.468144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.474301 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.474780 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.475210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.475898 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.476374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.476796 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.636081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.643451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5ca094e6-3462-47ea-97cb-099fdb21b316 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.213690 Aug 10 11:26:00.644300 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 211/441] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:00 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:00.648711 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.649313 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.655632 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.656153 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.656595 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.657292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.657747 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.658171 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.659384 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.667548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.669083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.670238 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7d34b4fc-3a44-4514-b409-361582032e5d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.207332 Aug 10 11:26:00.670791 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 231/442] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:00 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:26:00.717138 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:00.717867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:00.724190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.724672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.725098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.725777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:00.726268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:00.726725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:00.833498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.842678 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-98fd2135-3208-494e-800b-b5b2653f8080 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.197362 Aug 10 11:26:00.843344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 212/443] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:00 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:00.880775 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:00.888860 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-13c6501c-498c-4b5a-abb3-5be618f0416d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1272 microversion: 2.1 time: 0.176207 Aug 10 11:26:00.889358 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 232/444] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:00 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:01.304096 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:01.304612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:01.311920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.312433 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.312869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.313555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.314061 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.314479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.445599 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:01.453903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-58cceeb4-632c-4f0b-8869-2eb0bf1be80a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.153631 Aug 10 11:26:01.454527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 213/445] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:01 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:01.665768 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:01.666392 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:01.673304 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.673778 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.674202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.674872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.675312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.675727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.692624 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:01.693257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:01.699246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.699837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.700193 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.700914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.701363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.702089 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.873685 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:01.882147 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-658910c5-4e91-4e43-b4de-cc0cf8da942e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.220139 Aug 10 11:26:01.891915 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 233/446] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:01 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:01.892099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:01.892232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:01.892232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:01.894720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.895194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.895619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.896488 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.896996 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.897665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.903236 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:01.905070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:01.906420 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-57fbb0e0-7f40-4273-9440-b41294df0944 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.217610 Aug 10 11:26:01.906976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 214/447] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:01 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:26:01.912800 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:01.913658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:01.921431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.922153 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.922730 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:01.923592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:01.924283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:01.924848 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.130723 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:02.136378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:02.140750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a401eb09-fac0-44d5-9b57-31adbab68583 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.256412 Aug 10 11:26:02.144179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5055199b-6d3a-45e4-b8c8-4e6969b1a575 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1272 microversion: 2.1 time: 0.235019 Aug 10 11:26:02.144911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 215/448] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:01 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:02.155528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 234/449] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:01 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:02.474886 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:02.475564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:02.478585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:02.484645 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.501314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.501314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.501314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.501314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.501887 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.629668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:02.638060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-20a9c87a-28e1-4751-a5b0-c389cec88955 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.167397 Aug 10 11:26:02.638635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 216/450] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:02 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:02.903583 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:02.904221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:02.910087 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.910558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.910986 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.911663 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.912132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.912548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.934437 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:02.935395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:02.941947 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.942426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.942864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:02.943567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:02.944080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:02.944656 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.137576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:03.140408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:03.145233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7e2b9ff0-b3b9-4032-9f62-cdecf4148d0c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.245783 Aug 10 11:26:03.148950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:03.150566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:03.152476 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bfaa40fb-4b12-4069-8a31-76caf1a36768 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.223928 Aug 10 11:26:03.155264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 217/451] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:02 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:26:03.155404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 235/452] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:02 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:03.162561 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:03.164923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:03.165211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:03.165984 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:03.173717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.173921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.174193 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.174619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.174864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.175306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.175843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.176043 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.176329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.176750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.176860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.177173 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.384985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:03.390565 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:03.393592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c3dd721b-2585-4a72-9f3b-6e8a9ccf70a0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1272 microversion: 2.1 time: 0.231918 Aug 10 11:26:03.400310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 236/453] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:03 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:03.400496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:03.400496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-db6fb24c-fc6c-4447-8bb9-f21d1533c8ce tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.240564 Aug 10 11:26:03.400496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 218/454] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:03 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:03.401468 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-d6d4680f-055e-4524-a011-ec8084546feb req-2942ac0f-6c31-4ad8-8db0-1c4e0ad5053f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97faf99c-8b42-41ba-8242-38a47df81e60", "tag": "8afd3334-557f-4bbd-97db-30863c2d80cc"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:03.418969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-d6d4680f-055e-4524-a011-ec8084546feb req-2942ac0f-6c31-4ad8-8db0-1c4e0ad5053f service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.421827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-d6d4680f-055e-4524-a011-ec8084546feb req-2942ac0f-6c31-4ad8-8db0-1c4e0ad5053f service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.421827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-d6d4680f-055e-4524-a011-ec8084546feb req-2942ac0f-6c31-4ad8-8db0-1c4e0ad5053f service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.431137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-d6d4680f-055e-4524-a011-ec8084546feb req-2942ac0f-6c31-4ad8-8db0-1c4e0ad5053f service nova] Creating event network-changed:8afd3334-557f-4bbd-97db-30863c2d80cc for instance 97faf99c-8b42-41ba-8242-38a47df81e60 on hv-cinder-85061 Aug 10 11:26:03.435984 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-d6d4680f-055e-4524-a011-ec8084546feb req-2942ac0f-6c31-4ad8-8db0-1c4e0ad5053f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039969 Aug 10 11:26:03.436594 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 237/455] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:03.658796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:03.659411 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:03.666114 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.666741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.667028 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.667811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:03.668293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:03.668725 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:03.804839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:03.813196 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-58e63356-ed5a-479a-a65c-3ac77331b816 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.158480 Aug 10 11:26:03.814477 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 219/456] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:03 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:04.168041 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:04.168734 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:04.174846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.175325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.175751 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.176460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.176911 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.177331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.177580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:04.178191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:04.181923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:04.185263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.185748 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.186184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.186877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.187354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.187741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.377720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:04.384518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:04.390345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-bae62e42-a674-4360-b498-d9ad5e104480 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1319 microversion: 2.1 time: 0.226483 Aug 10 11:26:04.390972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 238/457] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:04 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:04.393480 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:04.394968 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:04.396534 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2558a78e-cef4-4cc0-b9a4-13f6ed0c2cf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.222505 Aug 10 11:26:04.397506 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 220/458] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:04 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:26:04.414273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:04.414903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:04.420835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:04.421429 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:04.421795 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.422280 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.422705 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.423388 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.423827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.424273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.427391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.427899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.428373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.429056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.429513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.429943 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.624387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:04.624498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:04.627100 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f72fee94-2a26-4e40-98c0-29e0f0cf9b20 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1272 microversion: 2.1 time: 0.216446 Aug 10 11:26:04.627669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 239/459] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:04 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:04.631321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c26b7653-f306-4b6c-b79c-98b71cb65ec1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.214975 Aug 10 11:26:04.631875 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 221/460] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:04 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:04.837041 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:04.837737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:04.844523 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.845008 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.845433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:04.846122 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:04.846570 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:04.847000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.089900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.098374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4aef4bb7-8ed1-41de-b8fc-474d5d179ba8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.266893 Aug 10 11:26:05.103625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-ab8be50a-ee2f-4044-8030-f27bcf74a47a req-b1592955-454b-4f96-a052-1f485ae8bf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34add072-ed4f-4601-b02e-e5b98edbb970", "name": "network-vif-plugged", "status": "completed", "tag": "fb19c135-b6e1-4aab-9034-c28ae9b55761"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:05.111830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 240/461] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:04 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:05.114348 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ab8be50a-ee2f-4044-8030-f27bcf74a47a req-b1592955-454b-4f96-a052-1f485ae8bf74 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.114824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ab8be50a-ee2f-4044-8030-f27bcf74a47a req-b1592955-454b-4f96-a052-1f485ae8bf74 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.115252 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ab8be50a-ee2f-4044-8030-f27bcf74a47a req-b1592955-454b-4f96-a052-1f485ae8bf74 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.131099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-ab8be50a-ee2f-4044-8030-f27bcf74a47a req-b1592955-454b-4f96-a052-1f485ae8bf74 service nova] Creating event network-vif-plugged:fb19c135-b6e1-4aab-9034-c28ae9b55761 for instance 34add072-ed4f-4601-b02e-e5b98edbb970 on hv-cinder-85061 Aug 10 11:26:05.136764 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-ab8be50a-ee2f-4044-8030-f27bcf74a47a req-b1592955-454b-4f96-a052-1f485ae8bf74 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035888 Aug 10 11:26:05.137187 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 222/462] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:26:05.411627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:05.412301 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:05.418942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.419477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.419893 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.420629 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.420763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:05.421079 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.421450 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:05.421551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.427749 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.428257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.428684 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.429360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.429803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.430221 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.621732 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.626353 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.629536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f2729d6b-0fe3-45e0-9fb2-68a642321dc9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1508 microversion: 2.1 time: 0.221823 Aug 10 11:26:05.630105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 241/463] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:05 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1508 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:05.634377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.636137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.637388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-039bf906-0ef7-494e-960a-d0d62f8fb9d0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.222195 Aug 10 11:26:05.638034 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 223/464] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:05 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:05.660619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:05.661637 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:05.668382 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:05.674561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.674719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:05.675241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.675914 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.677376 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.677905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.678525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.686850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.687442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.687956 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.688757 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:05.689282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:05.689780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:05.916812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.921672 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:05.925458 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-49e6ba10-ef24-4d35-8744-d5d66802caa1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.269780 Aug 10 11:26:05.926256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 242/465] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:05 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:05.929541 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0d957dc5-1609-482d-8d7d-fd47208cf149 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.270686 Aug 10 11:26:05.930375 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 224/466] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:05 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:06.118721 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:06.119174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:06.128313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.128313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.128313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.128313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.132179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.132179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.266331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:06.274115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-90ac7eb3-2d95-4e74-afe2-70163a6dcd35 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.159326 Aug 10 11:26:06.274701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 243/467] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:06 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:06.662365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:06.662970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:06.670009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.670493 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.670936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.671623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.672191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.672621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.827945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:06.836344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:06.837876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:06.839269 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a009452e-5d7a-47e7-acb2-a9f49e467ee1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.180896 Aug 10 11:26:06.839814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 225/468] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:06 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:06.949086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:06.949809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:06.950873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:06.951761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:06.956392 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.957317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.957551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.957729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.958040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.958421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.958531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.958885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.959143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:06.959495 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:06.959621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:06.960027 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:07.162070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:07.165887 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:07.170545 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0290ba76-8201-42a7-84e2-b4993729c728 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1372 microversion: 2.1 time: 0.223769 Aug 10 11:26:07.171114 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 226/469] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:06 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:07.173910 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9cf51230-63b4-422e-9b4b-5b735d187788 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.228831 Aug 10 11:26:07.174545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 244/470] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:06 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:07.296264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:07.296885 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:07.304279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:07.304760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:07.305189 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:07.305871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:07.306313 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:07.306728 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:07.443233 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:07.451842 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9e4b8d81-abe7-4bc0-9f42-afa0fce1cc5c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.160800 Aug 10 11:26:07.452544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 227/471] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:07 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:07.864680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:07.865291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:07.871316 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:07.871796 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:07.872263 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:07.872958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:07.873406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:07.873851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.005198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:08.014137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:08.015665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:08.016872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-793d610c-e26a-4139-a95e-566819cb27b4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.156571 Aug 10 11:26:08.017535 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 245/472] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:07 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:08.192510 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:08.193126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:08.194346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:08.194948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:08.200185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.200671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.200879 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.201108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.201355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.202042 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.202412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.202714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.202873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.203154 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.203298 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.203573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.411404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:08.414826 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:08.419113 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4365768a-e072-4c8b-9b50-fb84cb947283 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.228517 Aug 10 11:26:08.419772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 246/473] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:08 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:08.422811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-af628658-d7ee-4a94-9185-ff4a344ecdef tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1566 microversion: 2.1 time: 0.235161 Aug 10 11:26:08.423751 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 228/474] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:08 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:08.443459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:08.444097 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:08.451959 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.452477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.452909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.453604 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.454054 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.454476 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.472774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:08.473421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:08.479552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.480130 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.480578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.481442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:08.481898 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:08.482340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:08.574817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-27a219f0-9098-4bec-ad24-610487f0ec0c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135102 Aug 10 11:26:08.575597 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 247/475] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 10 11:26:08 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:08.650280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:08.659725 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-56bf722c-7f35-4f42-87b3-1efb8b05e6f4 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.190986 Aug 10 11:26:08.660533 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 229/476] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:08 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:09.041611 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:09.042777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:09.048426 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.048979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.049474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.050221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.050738 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.051369 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.065988 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:09.066581 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:09.074177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.074177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.074760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.075534 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.076084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.076857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.102556 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2af29d0c-7622-4cd2-bbb3-ab08fa826755 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/ips" status: 200 len: 145 microversion: 2.1 time: 0.040275 Aug 10 11:26:09.103467 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 230/477] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:26:09 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:26:09.203023 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:09.210996 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:09.212519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:09.214313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b206da09-1834-4513-985d-84c56212df17 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.176095 Aug 10 11:26:09.214877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 248/478] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:09 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:09.441991 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:09.443009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:09.450222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.450709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.451148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.454985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.455529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.455977 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.599595 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:09.607954 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e298c727-154d-42c7-9c2e-a6cde05440b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.172109 Aug 10 11:26:09.619146 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 231/479] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:09 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:09.689912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:09.689912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:09.698396 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.699316 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.699974 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.700936 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.702000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.702239 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-ba3389af-4af9-44e4-b1c5-9ffe6cc0daad req-b8f51cc2-8dd3-4056-95c4-34fba024593e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f999fcc-0926-4db9-9acc-218a002e1ae4", "tag": "c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:09.702764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.715081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ba3389af-4af9-44e4-b1c5-9ffe6cc0daad req-b8f51cc2-8dd3-4056-95c4-34fba024593e service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:09.715558 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ba3389af-4af9-44e4-b1c5-9ffe6cc0daad req-b8f51cc2-8dd3-4056-95c4-34fba024593e service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:09.715989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-ba3389af-4af9-44e4-b1c5-9ffe6cc0daad req-b8f51cc2-8dd3-4056-95c4-34fba024593e service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:09.730138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-ba3389af-4af9-44e4-b1c5-9ffe6cc0daad req-b8f51cc2-8dd3-4056-95c4-34fba024593e service nova] Creating event network-changed:c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5 for instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 on hv-cinder-85061 Aug 10 11:26:09.735419 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-ba3389af-4af9-44e4-b1c5-9ffe6cc0daad req-b8f51cc2-8dd3-4056-95c4-34fba024593e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036841 Aug 10 11:26:09.736059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 232/480] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:26:09.845341 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:09.853377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d6eb009f-defc-4d1a-886f-31ae9c8c8ece tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.175172 Aug 10 11:26:09.854552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 249/481] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:09 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:10.237855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:10.238655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:10.245076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:10.254426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:10.254426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:10.254426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:10.254426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:10.254888 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:10.480283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:10.488894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:10.490394 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:10.491799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-579c540c-d947-4fa2-b6df-2569fbd2ba7f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.258204 Aug 10 11:26:10.501061 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 233/482] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:10 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:10.630278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:10.630934 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:10.637770 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:10.638242 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:10.638877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:10.639733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:10.640364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:10.640940 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:10.866363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:10.874034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-912b9b07-a60b-42cd-a0ac-d3c12d3f2f6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.247388 Aug 10 11:26:10.876162 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:10.876773 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:10.882866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:10.883327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:10.883846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:10.884117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 250/483] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:10 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:10.884955 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:10.886797 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:10.887402 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:11.048850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:11.057007 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0a65e8fe-30c3-43ca-8f86-f5dc9c8b6e6a tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1357 microversion: 2.1 time: 0.184609 Aug 10 11:26:11.058792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 234/484] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:10 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:11.515869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:11.516427 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:11.522275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:11.522748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:11.523177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:11.523850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:11.524320 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:11.524740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:11.677288 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:11.685730 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:11.687615 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:11.688794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-69d1714d-b329-4798-b4c1-c9158f5da9a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.176892 Aug 10 11:26:11.689352 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 251/485] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:11 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:11.898040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:11.898648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:11.905729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:11.906210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:11.906641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:11.907328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:11.907781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:11.908233 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.052507 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:12.061555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-76c5ffa5-8d1a-432f-9d0f-2555774c120b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.167280 Aug 10 11:26:12.062128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 235/486] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:11 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:12.083205 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:12.083804 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:12.090302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.090778 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.091206 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.091877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.092357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.092773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.189930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:12.190621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:12.196545 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.197154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.197587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.198328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.198863 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.199279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.223132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-65f65396-7e5c-4a66-bce7-48fd1f941e6e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/ips" status: 200 len: 149 microversion: 2.1 time: 0.037336 Aug 10 11:26:12.226204 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:12.228415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 236/487] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:26:12 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:26:12.234777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-230d19ad-b28b-4730-bcf0-e44d4c581d4c tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1548 microversion: 2.1 time: 0.155343 Aug 10 11:26:12.235352 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 252/488] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:12 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:12.255806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:12.256429 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:12.262566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.263051 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.263528 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.264274 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.264733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.265175 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.287465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:12.410504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:12.418701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-acb9c621-3899-454a-8529-b57d0b59d501 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1548 microversion: 2.1 time: 0.166706 Aug 10 11:26:12.423754 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 237/489] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:12 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:12.441485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:12.447068 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:12.447856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Searching by: {'deleted': False, 'project_id': 'e202fe4250104681a9fe73fc4750c33f'} {{(pid=118425) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 11:26:12.458277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.458277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.458277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.458277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.458666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.458666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.547487 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.multi_cell_list [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118425) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 11:26:12.644713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b8814e6e-481d-4ed8-a3cb-76bef547dbf9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206814 Aug 10 11:26:12.645296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 253/490] 10.222.0.13 () {58 vars in 1125 bytes} [Wed Aug 10 11:26:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:12.657446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:12.658263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:12.664704 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.670405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.670405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.670405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.670405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.670785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.713291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:12.714618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:12.721028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.721517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.721952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.722648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:12.723096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:12.723520 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:12.865270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:12.874132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bcf466b5-0d6b-4877-afd3-f99c75169e58 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1548 microversion: 2.1 time: 0.220567 Aug 10 11:26:12.874895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 238/491] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:12 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1548 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:12.895839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:12.899247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:12.904427 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:12.906033 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:12.907191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6a8709ed-3e62-4f98-afdc-eca3df966b5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.198862 Aug 10 11:26:12.907921 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 254/492] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:12 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:26:12.991029 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3cd2996-d64e-4b30-8dca-179d3ec404c1"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:12.994390 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:13.003810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:13.004340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:13.004776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:13.005500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:13.005959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:13.006405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:13.087168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:13.093038 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:13.095179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:13.096052 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:13.096776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:13.097637 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:13.098258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:13.099001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:13.252321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:13.261401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-81de0d89-8eac-49ea-9bcd-355e445c9470 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.177913 Aug 10 11:26:13.262135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 255/493] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:13 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:13.934570 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:13.958404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:13.958404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:13.958404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:13.958404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:13.958863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:13.958863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:13.958863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:14.081780 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:14.090495 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:14.091989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:14.093189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8187390f-a936-4c85-923b-a69a6606167d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.163304 Aug 10 11:26:14.093749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 256/494] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:13 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:26:14.281665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:14.282270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:14.288191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:14.288674 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:14.289105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:14.289792 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:14.290242 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:14.290666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:14.426326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-28db319b-6e86-4c46-b93a-434f229fb22b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.439518 Aug 10 11:26:14.426939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 239/495] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:26:12 2022] POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/os-volume_attachments => generated 194 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:14.427542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:14.436702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7b68791e-91c5-4e07-94b4-912b7db1cc35 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.158864 Aug 10 11:26:14.437358 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 257/496] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:14 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:15.118179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:15.118948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:15.125859 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:15.126342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:15.126780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:15.127466 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:15.127916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:15.128363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:15.141729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:15.144021 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:15.151908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:15.152479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:15.152944 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:15.153632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:15.154075 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:15.154527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:15.269415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:15.278411 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:15.279892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:15.281055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-00bd08a6-436e-4d87-bbb5-aa134ac4ed33 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.167160 Aug 10 11:26:15.281639 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 240/497] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:15 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:15.458198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:15.458884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:15.466580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:15.467064 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:15.467496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:15.468227 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:15.468675 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:15.469126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:15.609866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:15.617296 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0e96594c-73a7-4ce8-8ee7-bb7859c04a68 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.163105 Aug 10 11:26:15.617856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 241/498] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:15 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:16.038872 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "197679ff-36b6-4241-89ef-23f7bdaf9f59"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:16.041438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:16.054663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:16.054663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:16.054663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:16.054663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:16.055004 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:16.055004 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:16.759047 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7075c10d-bafc-4389-a5d2-ce84ab80fea3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.621093 Aug 10 11:26:16.765806 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 258/499] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:26:15 2022] POST /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments => generated 194 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:26:16.766091 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:16.766792 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:16.773199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:16.773681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:16.774109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:16.774803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:16.775248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:16.775670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:16.909888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:16.918278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:16.921464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:16.922669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6d9be45c-0f24-477f-b384-fcf3abe7d078 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.160911 Aug 10 11:26:16.923292 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 259/500] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:16 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:16.928722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:16.929712 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:16.936729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:16.937223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:16.937659 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:16.938346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:16.938799 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:16.939220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:17.093826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:17.105173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-26af31a9-f84d-4737-88f4-f84c848b0cc6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.178959 Aug 10 11:26:17.106059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 260/501] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:16 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:17.278356 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-20b28075-7f85-4623-84a4-b2bcc0d6c445 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "POST /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.243211 Aug 10 11:26:17.279131 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 242/502] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:26:16 2022] POST /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments => generated 194 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:26:17.947890 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:17.949206 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:17.955739 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:17.956475 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:17.957117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:17.957810 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:17.958566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:17.959153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:18.109687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:18.118254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:18.121285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:18.122432 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-431747a5-27bc-4e6a-b448-7b7832745485 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.178520 Aug 10 11:26:18.122989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 261/503] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:17 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:18.137799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:18.138813 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:18.145669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:18.146080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:18.146517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:18.147246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:18.147702 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:18.148152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:18.313889 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:18.321657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a206d9da-c1c3-42d3-9d3a-12d216c3f86c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.190773 Aug 10 11:26:18.322233 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 243/504] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:18 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:19.145517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:19.146006 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:19.152707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:19.153194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:19.153626 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:19.154324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:19.154801 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:19.155229 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:19.311295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:19.319304 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:19.320851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:19.325380 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1dfa94d6-049f-4142-a3c1-aa4033a4a548 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.180815 Aug 10 11:26:19.325380 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 262/505] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:19 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:19.343063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:19.343846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:19.350598 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:19.351090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:19.351529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:19.352249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:19.352706 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:19.353132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:19.503910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:19.512792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d7f571d2-27c2-4877-b17c-e5b6ca8cecae tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.174103 Aug 10 11:26:19.513491 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 244/506] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:19 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:19.870319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-2b2a5220-cd77-48e1-a487-4e992aa680f5 req-795df38c-3edf-4f89-8e55-05a73d0c521f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97faf99c-8b42-41ba-8242-38a47df81e60", "name": "network-vif-plugged", "status": "completed", "tag": "8afd3334-557f-4bbd-97db-30863c2d80cc"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:19.884220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-2b2a5220-cd77-48e1-a487-4e992aa680f5 req-795df38c-3edf-4f89-8e55-05a73d0c521f service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:19.884884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-2b2a5220-cd77-48e1-a487-4e992aa680f5 req-795df38c-3edf-4f89-8e55-05a73d0c521f service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:19.889784 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-2b2a5220-cd77-48e1-a487-4e992aa680f5 req-795df38c-3edf-4f89-8e55-05a73d0c521f service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:19.896561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-2b2a5220-cd77-48e1-a487-4e992aa680f5 req-795df38c-3edf-4f89-8e55-05a73d0c521f service nova] Creating event network-vif-plugged:8afd3334-557f-4bbd-97db-30863c2d80cc for instance 97faf99c-8b42-41ba-8242-38a47df81e60 on hv-cinder-85061 Aug 10 11:26:19.901985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-2b2a5220-cd77-48e1-a487-4e992aa680f5 req-795df38c-3edf-4f89-8e55-05a73d0c521f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035407 Aug 10 11:26:19.902570 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 263/507] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:20.347784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:20.347784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:20.353129 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:20.353614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:20.354590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:20.355293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:20.355737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:20.356310 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:20.489400 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:20.498871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:20.500442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:20.501596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-74de7d7d-1d0d-43e7-8228-607a43d7070b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.160120 Aug 10 11:26:20.502143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 245/508] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:20 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:20.534313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:20.535010 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:20.541013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:20.542399 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:20.542859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:20.543544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:20.544025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:20.544440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:20.677278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:20.684948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3cd247b5-9ff9-4369-8ed3-1222b5fff74c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.155156 Aug 10 11:26:20.685514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 264/509] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:20 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:21.524650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:21.525267 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:21.533162 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:21.533719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:21.534244 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:21.534938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:21.535417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:21.535839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:21.687663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:21.696918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:21.699753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:21.705863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:21.706465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:21.710613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-468135f4-bec8-4386-ba5d-7d4951ff9812 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.189756 Aug 10 11:26:21.711375 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 246/510] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:21 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:21.715587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:21.716093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:21.716690 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:21.717544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:21.717990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:21.718410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:21.856193 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:21.863863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-394e53f1-19fd-494e-8428-71ab111f9257 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.162021 Aug 10 11:26:21.864456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 265/511] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:21 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:22.734200 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:22.734797 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:22.741337 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:22.741821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:22.742251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:22.742954 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:22.743376 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:22.743795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:22.875930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:22.884309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:22.884862 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:22.886269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:22.886406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:22.887911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e3930221-be17-4db2-9014-1c9acba43251 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.157574 Aug 10 11:26:22.888804 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 247/512] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:22 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:22.889027 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:22.894581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:22.895065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:22.895497 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:22.896216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:22.896672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:22.897095 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:23.047951 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:23.055383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cf3d5f77-0dca-4127-a5c0-fbe9266e480d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.174314 Aug 10 11:26:23.055942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 266/513] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:22 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:23.741145 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-33c14d64-0e63-47a8-95de-3023f7a86e22 req-54cba213-9b97-4e8f-84e6-6c7b1e41a970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf17719-c01d-4bcc-8a23-83d1a8a1a492", "name": "network-vif-plugged", "status": "completed", "tag": "4e6451ea-a107-42b4-9e4e-d34766a2f2d9"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:23.750828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-33c14d64-0e63-47a8-95de-3023f7a86e22 req-54cba213-9b97-4e8f-84e6-6c7b1e41a970 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:23.751309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-33c14d64-0e63-47a8-95de-3023f7a86e22 req-54cba213-9b97-4e8f-84e6-6c7b1e41a970 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:23.751736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-33c14d64-0e63-47a8-95de-3023f7a86e22 req-54cba213-9b97-4e8f-84e6-6c7b1e41a970 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:23.762530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-33c14d64-0e63-47a8-95de-3023f7a86e22 req-54cba213-9b97-4e8f-84e6-6c7b1e41a970 service nova] Creating event network-vif-plugged:4e6451ea-a107-42b4-9e4e-d34766a2f2d9 for instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 on hv-cinder-85061 Aug 10 11:26:23.767342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-33c14d64-0e63-47a8-95de-3023f7a86e22 req-54cba213-9b97-4e8f-84e6-6c7b1e41a970 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029993 Aug 10 11:26:23.767914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 248/514] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:23.910719 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:23.911328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:23.920425 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:23.920909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:23.921342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:23.922090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:23.922593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:23.923028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:24.060965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:24.074182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:24.076076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:24.077608 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d2d6f07b-392a-4371-8d97-3da453374df5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.170902 Aug 10 11:26:24.085077 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:24.085691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:24.089421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 267/515] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:23 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:24.092851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:24.093557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:24.094167 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:24.095010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:24.095621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:24.096084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:24.232238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:24.239896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-53667dbb-b316-4a6c-a285-639fe1386344 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1260 microversion: 2.1 time: 0.158915 Aug 10 11:26:24.240492 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 249/516] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:24 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:25.102265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:25.102954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:25.110088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:25.110356 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:25.110800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:25.111631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:25.112135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:25.112624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:25.250577 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:25.258471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:25.260031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:25.267000 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:25.267452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ff6b21ae-ce4c-4835-b695-a800665142e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.163940 Aug 10 11:26:25.267547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:25.267646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 268/517] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:25 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:25.268986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:25.269471 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:25.269926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:25.270599 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:25.271084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:25.271570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:25.405808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:25.413802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-befc4057-93de-41e4-b9e6-3ec645073e15 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1443 microversion: 2.1 time: 0.156825 Aug 10 11:26:25.414395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 250/518] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:25 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:25.434858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:25.435469 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:25.441266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:25.441753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:25.442191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:25.442887 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:25.443342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:25.443768 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:25.579088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:25.586582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d3b17f4b-9085-42e7-af88-8f1f478af7ff tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1443 microversion: 2.1 time: 0.156169 Aug 10 11:26:25.587139 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 269/519] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:25 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:26.285162 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:26.285818 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:26.292190 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:26.292674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:26.293109 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:26.293796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:26.294243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:26.294664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:26.499488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:26.507591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:26.509099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:26.511030 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-348d3d21-5c8e-4c04-a735-65b53f199a42 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.229046 Aug 10 11:26:26.511781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 251/520] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:26 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:27.533776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:27.534380 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:27.540794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:27.541273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:27.542062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:27.542438 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:27.542918 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:27.543345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:27.784707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:27.788250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:27.794242 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:27.795786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:27.801955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e532bff2-98e4-4b4a-ad55-3c2e4775ea7c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.267217 Aug 10 11:26:27.801955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 270/521] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:27 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:28.111909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-68649d32-6217-43c3-bf2c-f9728639581b req-a89ff203-55f8-4354-b828-dc58a38d4079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97faf99c-8b42-41ba-8242-38a47df81e60", "tag": "8afd3334-557f-4bbd-97db-30863c2d80cc"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:28.122122 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-68649d32-6217-43c3-bf2c-f9728639581b req-a89ff203-55f8-4354-b828-dc58a38d4079 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:28.122593 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-68649d32-6217-43c3-bf2c-f9728639581b req-a89ff203-55f8-4354-b828-dc58a38d4079 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:28.123017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-68649d32-6217-43c3-bf2c-f9728639581b req-a89ff203-55f8-4354-b828-dc58a38d4079 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:28.127232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:28.135226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-68649d32-6217-43c3-bf2c-f9728639581b req-a89ff203-55f8-4354-b828-dc58a38d4079 service nova] Creating event network-changed:8afd3334-557f-4bbd-97db-30863c2d80cc for instance 97faf99c-8b42-41ba-8242-38a47df81e60 on hv-cinder-85061 Aug 10 11:26:28.140561 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-68649d32-6217-43c3-bf2c-f9728639581b req-a89ff203-55f8-4354-b828-dc58a38d4079 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032295 Aug 10 11:26:28.144107 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 252/522] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:28.820828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:28.821429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:28.824033 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=94 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:28.829236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:28.831622 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:28.831622 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:28.831622 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:28.831622 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:28.831984 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:28.970555 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:28.980401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:28.981866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:28.983220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-374b45cf-d17a-43f9-8b8c-5cd347bbcece tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.166365 Aug 10 11:26:28.987346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 271/523] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:28 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:30.007636 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:30.008343 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:30.015543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:30.016028 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:30.016456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:30.017179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:30.017622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:30.018040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:30.153690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:30.161510 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:30.163054 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:30.164219 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3f0c5dca-cfb1-464b-88b9-7d5911f9ec1e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.161655 Aug 10 11:26:30.164771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 253/524] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:30 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:31.186619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:31.187232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:31.193647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:31.194139 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:31.194571 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:31.195254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:31.195709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:31.196165 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:31.328192 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:31.336090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:31.337577 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:31.339251 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a6b897fd-d395-4ce9-9efb-5b55f902d744 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.156474 Aug 10 11:26:31.339800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 272/525] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:31 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:32.362560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:32.363164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:32.370936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:32.371418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:32.371846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:32.372748 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:32.373005 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:32.373429 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:32.502607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:32.510638 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:32.512338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:32.513482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ce1fb82f-a301-48b7-a892-60ba37f3eb88 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.154905 Aug 10 11:26:32.514149 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 254/526] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:32 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:33.535967 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:33.536630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:33.544051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:33.544579 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:33.544990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:33.545719 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:33.546181 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:33.546603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:33.695685 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3195ff2f-9876-4818-b8b0-2170a41be868 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:33.699799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=78 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:33.704861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3195ff2f-9876-4818-b8b0-2170a41be868 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:33.705417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3195ff2f-9876-4818-b8b0-2170a41be868 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:33.705979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3195ff2f-9876-4818-b8b0-2170a41be868 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:33.754169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:33.775179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:33.775179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:33.775179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6f956a97-38ce-4cf8-9c85-7a232df372d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.235947 Aug 10 11:26:33.775636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 273/527] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:33 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:33.775747 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3195ff2f-9876-4818-b8b0-2170a41be868 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Going to try to stop instance {{(pid=118426) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 11:26:34.168500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3195ff2f-9876-4818-b8b0-2170a41be868 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/action" status: 202 len: 0 microversion: 2.1 time: 0.476417 Aug 10 11:26:34.169180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 255/528] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:26:33 2022] POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:26:34.177378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:34.177999 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:34.184885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:34.185633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:34.186137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:34.187031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:34.187553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:34.188024 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:34.326551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:34.334885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fefca9cc-b1e1-416c-83d6-6c054b388b80 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.161386 Aug 10 11:26:34.335445 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 274/529] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:34 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:34.792301 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:34.792995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:34.799327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:34.799813 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:34.800342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:34.801061 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:34.801587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:34.802033 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:34.936488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:34.945051 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:34.946629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:34.948518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8b3023d3-d7d2-41b1-bd47-93bcbfa2f1d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.160408 Aug 10 11:26:34.949076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 256/530] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:34 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:35.356343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:35.356970 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:35.363382 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:35.363856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:35.364312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:35.364995 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:35.365441 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:35.365861 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:35.500474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:35.507275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-195e23ca-3ab2-4cd8-95da-78153a58d883 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.155327 Aug 10 11:26:35.507831 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 275/531] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:35 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:35.971861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:35.972575 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:35.979304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:35.979784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:35.980327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:35.981015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:35.981461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:35.981878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:36.109293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:36.117268 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:36.118767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:36.120012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-99bb9238-9eb6-488a-bb33-b1ac2e5b7b35 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.151989 Aug 10 11:26:36.120574 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 257/532] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:35 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:36.528381 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:36.528990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:36.535243 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:36.535715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:36.536190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:36.536879 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:36.537330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:36.537782 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:36.676209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:36.684987 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a1f42318-7bcf-4ee0-aef2-8925ead3d44c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.160707 Aug 10 11:26:36.685558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 276/533] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:36 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:37.142459 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:37.143055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:37.149404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:37.149879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:37.150307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:37.151554 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:37.152018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:37.152469 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:37.282176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:37.290491 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:37.292664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:37.293813 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-138588cb-e887-4645-a15c-3264235bbe46 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.155207 Aug 10 11:26:37.294375 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 258/534] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:37 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:37.706254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:37.706887 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:37.715155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:37.715648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:37.716105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:37.716800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:37.717254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:37.717679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:37.848237 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:37.856691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-589d2d17-61d6-4107-af1e-02dd957918c7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.154471 Aug 10 11:26:37.857260 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 277/535] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:37 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:38.319692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:38.320429 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:38.327035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:38.327785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:38.328246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:38.328933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:38.329409 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:38.329834 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:38.461720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:38.470479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:38.472071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:38.473227 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-27ff8976-4203-4c15-af4c-50318b62b0c1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.157501 Aug 10 11:26:38.473820 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 259/536] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:38 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:38.878339 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:38.878961 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:38.885981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:38.886466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:38.886900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:38.887581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:38.888056 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:38.888485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:39.018624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:39.027381 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b0bbf875-6bc3-496f-903f-a6946ad55b1a tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.152893 Aug 10 11:26:39.027938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 278/537] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:38 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:39.497711 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:39.498445 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:39.505477 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:39.505962 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:39.506399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:39.507210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:39.507815 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:39.508339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:39.641787 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:39.649741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:39.651238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:39.652404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-68a5711e-eb30-4066-9872-f7e95d33eda9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.159938 Aug 10 11:26:39.652961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 260/538] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:39 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:40.048354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:40.048966 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:40.055335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:40.057256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:40.057256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:40.057256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:40.057555 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:40.057908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:40.189012 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:40.197460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-27ff7bcc-6fa4-4599-afb4-04698cb98b16 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.152789 Aug 10 11:26:40.200595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 279/539] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:40 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:40.675407 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:40.676021 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:40.682461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:40.682933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:40.683365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:40.684060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:40.684509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:40.684926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:40.816970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:40.825796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:40.827537 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:40.828700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2bf4a4d9-54e6-44f6-953a-e41638a1ccf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.157557 Aug 10 11:26:40.829259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 261/540] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:40 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:41.219376 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:41.219906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:41.226166 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:41.226649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:41.227076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:41.227750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:41.228226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:41.228664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:41.401339 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:41.401339 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c1a2ce16-6621-40fe-ab54-5f27445f6f18 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.150691 Aug 10 11:26:41.401339 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 280/541] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:41 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:41.851318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:41.851915 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:41.859350 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:41.859822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:41.860288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:41.860968 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:41.861433 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:41.861872 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:41.999688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:42.007505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:42.009012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:42.010927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b0e56d3f-af42-472b-8c2c-264febdb782e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.162704 Aug 10 11:26:42.011344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 262/542] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:41 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:42.419648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:42.420277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:42.426524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:42.427003 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:42.427441 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:42.428143 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:42.428594 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:42.429013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:42.565935 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:42.574706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-00f09043-955a-46b2-925a-6ef5ae50643e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.159029 Aug 10 11:26:42.575284 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 281/543] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:42 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:43.033597 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:43.034056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:43.040966 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:43.042119 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:43.042557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:43.043248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:43.043696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:43.044141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:43.173591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:43.181799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:43.183292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:43.184456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-631ab443-7c9a-43ac-a714-93418d49e46f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.154943 Aug 10 11:26:43.185210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 263/544] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:43 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:43.596513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:43.597122 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:43.603530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:43.604218 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:43.604522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:43.605207 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:43.605658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:43.606083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:43.737436 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:43.745900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ddf858fc-ba93-43ef-a257-a5cfbf5082df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.153174 Aug 10 11:26:43.746464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 282/545] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:43 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:44.207267 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:44.207876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:44.214721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:44.215204 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:44.215638 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:44.216359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:44.216811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:44.217235 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:44.345270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:44.353373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:44.355442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:44.356654 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-97fd72e1-ec6e-45e2-8bf2-043bac037dfa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.153457 Aug 10 11:26:44.357329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 264/546] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:44 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:44.766889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:44.767500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:44.773869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:44.774350 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:44.774786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:44.775523 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:44.776060 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:44.776485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:44.910950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:44.919026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8b10ccf6-477f-4d8c-b347-1ce0836689fe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.155940 Aug 10 11:26:44.919599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 283/547] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:44 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:45.379978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:45.380736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:45.388088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:45.388571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:45.389003 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:45.389687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:45.390135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:45.390555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:45.525083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:45.533278 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:45.534767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:45.535909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3ccc9758-0102-4d9a-8218-ef2eb571c370 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1743 microversion: 2.20 time: 0.159882 Aug 10 11:26:45.536490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 265/548] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:45 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:45.940622 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:45.941187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:45.947174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:45.947707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:45.948180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:45.948890 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:45.949344 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:45.949766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:46.077014 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:46.085327 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-33f25e90-bffc-4e83-beea-f78c201f34ef tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.148894 Aug 10 11:26:46.085888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 284/549] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:45 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:46.558693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:46.559346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:46.565893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:46.566372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:46.566806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:46.567489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:46.567937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:46.568386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:46.701083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:46.709219 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:46.710704 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:46.711828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a6824cce-c88a-4220-abaf-ca3e2d9cf9f6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.157132 Aug 10 11:26:46.712419 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 266/550] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:46 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:47.106706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:47.107455 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:47.113778 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:47.114283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:47.114720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:47.115412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:47.115893 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:47.116338 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:47.248917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:47.257676 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4f6d6521-9db0-4265-ac4b-094c7728392e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.154901 Aug 10 11:26:47.258557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 285/551] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:47 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:47.740742 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:47.741355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:47.748017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:47.748527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:47.748965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:47.749661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:47.750114 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:47.750560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:47.878794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:47.887117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:47.888634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:47.889765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-cf8ba544-132f-4ff2-9cf9-f8db4418a8ff tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.153116 Aug 10 11:26:47.890312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 267/552] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:47 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:26:48.278353 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:48.278967 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:48.285331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:48.285822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:48.286305 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:48.287032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:48.287491 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:48.287920 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:48.432989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:48.441093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5d020c27-1dda-4121-ad07-14b045ea9b7b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.166799 Aug 10 11:26:48.441668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 286/553] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:48 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:48.913126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:48.913725 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:48.920720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:48.921194 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:48.921629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:48.922299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:48.922746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:48.923162 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:48.941264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:49.053225 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:49.061249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:49.062746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:49.063971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-33f999d7-b0c4-425f-ae0f-fba2e75675e9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.154701 Aug 10 11:26:49.064555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 268/554] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:48 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:49.462743 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:49.463553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:49.470152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:49.470641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:49.471172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:49.471885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:49.472410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:49.472847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:49.491238 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:49.609220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:49.617547 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-bc3ecd5b-3daa-4259-ad8e-f1c128384801 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.158667 Aug 10 11:26:49.618135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 287/555] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:49 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:50.086921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:50.087542 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:50.094388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:50.106821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:50.106821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:50.106821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:50.106821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:50.107212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:50.229783 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:50.238106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:50.239629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:50.240804 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-df5f114a-7771-4c4c-b12b-9e29db3b9e16 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.157768 Aug 10 11:26:50.241356 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 269/556] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:50 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:50.639589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:50.640234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:50.646063 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:50.646547 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:50.646983 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:50.647665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:50.648144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:50.648568 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:50.780300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:50.788332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b1cb0043-957c-4c1d-9993-8d3bbc9a2cb1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.153647 Aug 10 11:26:50.788895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 288/557] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:50 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:51.031370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-792982e4-f0d0-4ce0-b3f2-f4c324bfa45e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: .version_select at 0x7f6f441011f0>, body: {"keypair": {"name": "tempest-keypair-626006577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVYswN0L1y6mWuVBqQjaBPcx6oDXo8sUWSbsdIKnG/fvgXtXarsTqYuF16Ksu63shRDSQF5GS2i7tTfsXxO3LvOerB6XqAuLiXt688yznyoAMs0NPKqHUVeWGLAz6P3FQ=="}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:51.047057 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-792982e4-f0d0-4ce0-b3f2-f4c324bfa45e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:26:51.050801 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-792982e4-f0d0-4ce0-b3f2-f4c324bfa45e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for user 0782e27e2318438fbf155dfa9cb834b6 and project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:26:51.184412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-792982e4-f0d0-4ce0-b3f2-f4c324bfa45e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.156860 Aug 10 11:26:51.185055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 270/558] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:26:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:26:51.263766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:51.264321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:51.270190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:51.273763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:51.273763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:51.273763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:51.273763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:51.274131 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:51.452020 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:51.461146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:51.462963 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:51.464973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ca033f8a-5d89-4d2f-99fa-817663b38c3c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.205163 Aug 10 11:26:51.468080 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 289/559] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:51 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:51.808912 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:51.809456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:51.820927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:51.820927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:51.820927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:51.820927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:51.821261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:51.821261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:51.990198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:52.000106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-97f8c520-c392-4afa-a6e7-c94a88d769ac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.195636 Aug 10 11:26:52.000681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 271/560] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:51 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:52.487041 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:52.487643 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:52.494467 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:52.494952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:52.495383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:52.496880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:52.497348 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:52.497777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:52.702833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:52.704723 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:52.706393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:52.707553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4347f9b6-2645-4784-9460-e68b5d6bb304 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.224701 Aug 10 11:26:52.708605 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 290/561] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:52 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:53.022151 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:53.022933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:53.029687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:53.030169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:53.030601 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:53.031295 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:53.031745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:53.032197 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:53.189905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:53.198745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-516990b4-ee86-4aeb-a49f-c76cd0255cce tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.180534 Aug 10 11:26:53.211052 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 272/562] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:53 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:53.732385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:53.732991 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:53.745134 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:53.746020 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:53.746639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:53.747488 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:53.748518 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:53.749347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:53.937857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:53.947764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:53.949361 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:53.957390 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-43565bc1-b3ea-420c-aa0c-a13ed70526ad tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.222812 Aug 10 11:26:53.960783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 291/563] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:53 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:54.220376 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:54.221720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:54.229695 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:54.230451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:54.231258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:54.232232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:54.232789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:54.233288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:54.437036 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:54.452462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ee13475b-77f6-49ea-bc05-d106bfee30eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.230729 Aug 10 11:26:54.452462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 273/564] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:54 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:54.673903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2036925262", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24c11727-9280-4b85-b477-78482251b877"}], "security_groups": [{"name": "tempest-securitygroup--1927444033"}], "key_name": "tempest-keypair-626006577", "user_data": "}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:54.795469 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] validate_networks() for [('24c11727-9280-4b85-b477-78482251b877', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:26:54.980206 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:54.981159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:54.996859 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:54.998082 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:54.998832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:54.999979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:55.000768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:55.001455 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:55.306083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:55.315854 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:55.317611 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:55.318772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-23f0af86-d347-4d13-935f-88bb9a8f847e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.345628 Aug 10 11:26:55.319518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 274/565] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:54 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:26:55.380368 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:26:55.381216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:26:55.381928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:26:55.382694 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:26:55.383313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:26:55.394199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:55.394817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:55.395383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:55.396431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:55.397415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:55.398060 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:55.419031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:26:55.424429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for user 0782e27e2318438fbf155dfa9cb834b6 and project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:26:55.437129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:26:55.439772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:26:55.474878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:55.475489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:55.481776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:55.482541 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:55.483143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:55.483843 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:55.484329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:55.484754 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:55.654492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8668e80d-87f9-498a-9487-4be7e3d5afe8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.986799 Aug 10 11:26:55.655389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 292/566] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:26:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:26:55.667698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9b4648ec-9a0f-4d34-ae56-ce660eb71b61 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:55.668335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9b4648ec-9a0f-4d34-ae56-ce660eb71b61 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:55.835674 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9b4648ec-9a0f-4d34-ae56-ce660eb71b61 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:55.856787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9b4648ec-9a0f-4d34-ae56-ce660eb71b61 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1241 microversion: 2.1 time: 0.192444 Aug 10 11:26:55.857964 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 293/567] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:55 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1241 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:55.924530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:55.932818 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1356866b-4a92-4011-afda-2f55214f1b01 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.461440 Aug 10 11:26:55.935131 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 275/568] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:55 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:26:56.344450 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:56.345414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:56.351611 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:56.352123 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:56.352748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:56.354219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:56.354915 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:56.355504 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:56.528730 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:56.537978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:56.539581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:56.540816 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2ab25a45-7c21-4de6-b3e9-4fa3c9d60437 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.200054 Aug 10 11:26:56.557542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 294/569] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:56 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:56.879272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-daf3261b-8b86-4a55-8c8a-a48ddb1d6856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:56.880123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-daf3261b-8b86-4a55-8c8a-a48ddb1d6856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:56.945822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-daf3261b-8b86-4a55-8c8a-a48ddb1d6856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:56.954917 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-daf3261b-8b86-4a55-8c8a-a48ddb1d6856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1241 microversion: 2.1 time: 0.079888 Aug 10 11:26:56.968667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:56.969305 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:56.970874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 276/570] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:56 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:56.978722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:56.980172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:56.980765 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:56.981478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:56.982089 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:56.982593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:57.139827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:57.148165 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5a778756-6e53-4205-a97a-0e89e334fda9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.183512 Aug 10 11:26:57.148731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 295/571] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:56 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:57.565228 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:57.565833 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:57.571731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:57.573019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:57.573462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:57.574148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:57.574673 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:57.575094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:57.704669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:57.712506 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:57.714270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:57.715410 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-11c0a249-f502-4648-8b36-3ee4a742b598 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.154151 Aug 10 11:26:57.715961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 277/572] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:57 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:57.980412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9e865a64-b847-4f8c-854b-8186c9442f4e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:57.980936 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9e865a64-b847-4f8c-854b-8186c9442f4e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:58.042195 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9e865a64-b847-4f8c-854b-8186c9442f4e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:58.049658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9e865a64-b847-4f8c-854b-8186c9442f4e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1241 microversion: 2.1 time: 0.076999 Aug 10 11:26:58.051414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 296/573] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:57 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:58.173509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:58.174891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:58.182036 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:58.183500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:58.183500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:58.183966 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:58.184655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:58.185154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:58.372636 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:58.383324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-89ab8dca-ca64-429d-b7cf-397cd4bef269 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.217333 Aug 10 11:26:58.383901 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 278/574] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:58 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:58.737819 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:58.738774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:58.746820 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:58.747375 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:58.747816 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:58.748558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:58.749189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:58.749779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:58.903258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:58.913935 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:58.915464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:58.916809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-50396ad2-0a0f-445a-b2c2-3353c2b86023 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.182923 Aug 10 11:26:58.917395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 297/575] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:58 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:26:59.070897 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:59.071499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:59.078684 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:59.079160 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:59.079799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:59.080515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:59.080990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:59.081413 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:59.169063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:59.177885 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-03f17f72-071e-426b-9da6-f91b3ec891f4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1245 microversion: 2.1 time: 0.110829 Aug 10 11:26:59.191932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 279/576] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:59 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:59.233114 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "231d8b25-0749-4da7-b84e-cfa528bd7995", "device": "/dev/sdb"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:26:59.236215 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:59.239698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:26:59.243165 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:59.243646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:59.244850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:59.245673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:59.246132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:59.246558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:59.407506 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:59.408370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:59.417996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:59.418492 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:59.420306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:59.420306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:59.423135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:59.424031 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:59.585516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:26:59.596827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-39ebabb8-4d95-45b3-8042-b8287ca7edf2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.194188 Aug 10 11:26:59.597397 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 280/577] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:26:59 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:26:59.942551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:26:59.943289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:26:59.951027 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:59.951924 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:59.953005 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:26:59.953883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:26:59.954420 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:26:59.954857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:00.108467 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:00.117415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:00.119177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:00.120987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b123eb77-0932-4ffa-9be5-296fdc9b2139 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.183263 Aug 10 11:27:00.124789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 281/578] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:26:59 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:27:00.205224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:00.206467 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:00.216106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:00.216831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:00.217475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:00.218256 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:00.218806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:00.219339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:00.292809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:00.300765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-20453c3a-a5ed-41e9-906c-b55d644aa14c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1293 microversion: 2.1 time: 0.105669 Aug 10 11:27:00.301547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 282/579] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:00 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:27:00.622978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:00.623668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:00.630314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:00.631117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:00.631887 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:00.632881 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:00.633448 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:00.633973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:00.814740 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:00.834103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ee91942c-c039-4226-9074-68985516d0b6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1723 microversion: 2.1 time: 0.219265 Aug 10 11:27:00.834786 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 283/580] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:00 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:01.145010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:01.145683 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:01.152970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:01.153463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:01.154221 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:01.155170 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:01.155635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:01.156090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:01.336282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:01.344786 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:01.346272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:01.347567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-40894712-c9d9-4861-a8a7-bece4cbe414a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.206710 Aug 10 11:27:01.348146 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 284/581] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:01 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:27:01.352538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:01.353141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:01.359660 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:01.360187 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:01.360643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:01.361324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:01.361823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:01.362504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:01.428729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:01.436330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-354a5a45-1ebf-4c83-8c4b-33ff29cfd486 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1301 microversion: 2.1 time: 0.087210 Aug 10 11:27:01.436901 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 285/582] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:01 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:01.855231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:01.855969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:01.862769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:01.863335 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:01.863850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:01.864583 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:01.865035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:01.865455 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:02.000464 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:02.008790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-72ef3ff0-d387-43b7-81b0-6b7059fb9a05 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1700 microversion: 2.1 time: 0.158039 Aug 10 11:27:02.009347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 286/583] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:01 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1700 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:27:02.030074 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fc4c9ea5-204a-4052-a79e-934d20095b7f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:02.036103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc4c9ea5-204a-4052-a79e-934d20095b7f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:02.036641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc4c9ea5-204a-4052-a79e-934d20095b7f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:02.037071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fc4c9ea5-204a-4052-a79e-934d20095b7f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:02.040401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:02.061208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fc4c9ea5-204a-4052-a79e-934d20095b7f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Going to try to start instance {{(pid=118426) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 11:27:02.732835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fc4c9ea5-204a-4052-a79e-934d20095b7f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/action" status: 202 len: 0 microversion: 2.1 time: 0.701453 Aug 10 11:27:02.732835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 287/584] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:27:02 2022] POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:27:02.745107 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:02.747286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:02.774970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:02.776650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:02.777106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:02.780680 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:02.783734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:02.784242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:03.143743 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:03.155112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:03.156769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:03.157954 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f4e57eb8-26df-4ff7-a491-8554ae03417c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.427925 Aug 10 11:27:03.158692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 288/585] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:02 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:03.176483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d2440902-94fc-4252-9619-39f386d32ea3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "POST /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.947236 Aug 10 11:27:03.182749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 298/586] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:26:59 2022] POST /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac/os-volume_attachments => generated 194 bytes in 3955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:03.188682 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:03.189724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:03.193121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:03.193852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:03.216565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:03.218244 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:03.220569 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:03.221022 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:03.221808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:03.222212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:03.222638 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:03.223180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:03.225010 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:03.225940 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:03.228610 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:03.230524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:03.502634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:03.511781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fbd001c7-4cf1-4b65-a393-45e9ad7a9377 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1379 microversion: 2.1 time: 0.351998 Aug 10 11:27:03.518583 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 289/587] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:03 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1379 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:03.772271 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:03.781841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:03.783048 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:03.785552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-666eb523-12e6-427e-a9b7-19f038b702a8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1709 microversion: 2.1 time: 0.600605 Aug 10 11:27:03.785740 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:03.786196 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 299/588] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:03 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1709 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:03.792813 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:03.794498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:03.795160 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:03.796244 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:03.796944 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:03.797556 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:04.123342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:04.135625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0a3abb57-90f5-4ab9-bc55-b87b43f2d17b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1594 microversion: 2.1 time: 0.357530 Aug 10 11:27:04.148110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 290/589] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:03 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1594 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:04.182652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:04.183353 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:04.190772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:04.191290 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:04.197469 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:04.198585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:04.201217 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:04.201906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:04.422789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:04.427117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:04.430432 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:04.432230 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d52343d3-6c18-4dd8-a52e-453727b57e02 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.253541 Aug 10 11:27:04.433105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 300/590] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:04 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:04.551553 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:04.552485 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:04.563614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:04.564201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:04.569124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:04.569124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:04.569124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:04.569124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:04.833472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:04.834093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:04.859496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:04.872826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:04.884894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:04.886772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:04.887860 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:04.888995 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:05.051664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:05.059844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-928e288c-34ac-47a6-ad16-9a3ae1ceff1c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.517286 Aug 10 11:27:05.061117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 291/591] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:04 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:05.250106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:05.261566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b978b4f0-271b-452b-a0b1-f90c0d34ecff tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1709 microversion: 2.1 time: 0.443015 Aug 10 11:27:05.277161 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 301/592] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:04 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1709 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:05.433882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-2c9f9477-7d84-4c73-a1a2-ccb0829068a5 req-8d6d9552-7933-432b-a2bb-3085844c0759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf2a390-b869-4d2f-9013-63011c65a796", "tag": "0fa11193-0b09-4b89-88fe-421118ac0b2a"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:05.455016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:05.456154 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:05.464523 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:05.467591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-2c9f9477-7d84-4c73-a1a2-ccb0829068a5 req-8d6d9552-7933-432b-a2bb-3085844c0759 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:05.468903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:05.471923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:05.472702 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-2c9f9477-7d84-4c73-a1a2-ccb0829068a5 req-8d6d9552-7933-432b-a2bb-3085844c0759 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:05.477442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:05.477442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:05.477442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:05.477442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:05.477772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-2c9f9477-7d84-4c73-a1a2-ccb0829068a5 req-8d6d9552-7933-432b-a2bb-3085844c0759 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:05.494844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-2c9f9477-7d84-4c73-a1a2-ccb0829068a5 req-8d6d9552-7933-432b-a2bb-3085844c0759 service nova] Creating event network-changed:0fa11193-0b09-4b89-88fe-421118ac0b2a for instance baf2a390-b869-4d2f-9013-63011c65a796 on hv-cinder-85061 Aug 10 11:27:05.500556 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-2c9f9477-7d84-4c73-a1a2-ccb0829068a5 req-8d6d9552-7933-432b-a2bb-3085844c0759 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072401 Aug 10 11:27:05.501432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 292/593] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:05.631490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:05.642497 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:05.644162 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:05.645538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5d541db8-0d7b-4144-87ee-2be3b9cdf2e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.194787 Aug 10 11:27:05.646225 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 302/594] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:05 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:06.083280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:06.083968 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:06.095612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:06.100938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:06.101409 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:06.102127 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:06.102581 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:06.103005 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:06.284437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:06.286711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:06.295907 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:06.296441 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:06.297131 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:06.297929 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:06.298485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:06.298988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:06.793393 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:06.799709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:06.801042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a47951dd-95dd-498d-a1d2-10adfd9420a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.722447 Aug 10 11:27:06.801617 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 293/595] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:06 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:06.806235 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:06.807442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:06.808773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b9a9aad6-c982-4526-8d9a-5764948f4019 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1713 microversion: 2.1 time: 0.529730 Aug 10 11:27:06.809531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 303/596] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:06 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1713 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:06.814963 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:06.815445 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:06.815885 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:06.816678 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:06.817121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:06.817722 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:06.951604 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=6 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:06.976253 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:06.984853 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:06.986329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:06.987462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c8b11656-1e09-4d75-a33f-be99329d599a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.184781 Aug 10 11:27:06.988039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 294/597] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:06 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:07.826805 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:07.827438 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:07.834110 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:07.834881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:07.835820 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:07.836912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:07.837680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:07.839168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:08.012172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:08.014781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:08.024730 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:08.033132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:08.033132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:08.033132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:08.033132 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:08.033542 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:08.049319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=10 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:08.125138 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:08.135889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d212c828-2cd9-41c7-b4c0-1ddf80811f54 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.312604 Aug 10 11:27:08.137268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 304/598] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:07 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:08.236250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:08.244805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:08.244805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:08.261591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-814bf142-781d-4836-b81e-558590db2a1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.242597 Aug 10 11:27:08.261591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 295/599] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:08 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:08.554994 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-df6ef7ad-8514-420e-b868-d91607d1841f req-b7c49416-df1e-404d-be04-6a0b3fbce3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34add072-ed4f-4601-b02e-e5b98edbb970", "tag": "fb19c135-b6e1-4aab-9034-c28ae9b55761"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:08.566163 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-df6ef7ad-8514-420e-b868-d91607d1841f req-b7c49416-df1e-404d-be04-6a0b3fbce3f8 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:08.567386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-df6ef7ad-8514-420e-b868-d91607d1841f req-b7c49416-df1e-404d-be04-6a0b3fbce3f8 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:08.567830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-df6ef7ad-8514-420e-b868-d91607d1841f req-b7c49416-df1e-404d-be04-6a0b3fbce3f8 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:08.583835 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-df6ef7ad-8514-420e-b868-d91607d1841f req-b7c49416-df1e-404d-be04-6a0b3fbce3f8 service nova] Creating event network-changed:fb19c135-b6e1-4aab-9034-c28ae9b55761 for instance 34add072-ed4f-4601-b02e-e5b98edbb970 on hv-cinder-85061 Aug 10 11:27:08.589132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-df6ef7ad-8514-420e-b868-d91607d1841f req-b7c49416-df1e-404d-be04-6a0b3fbce3f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038418 Aug 10 11:27:08.589986 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 305/600] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:09.157868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:09.158521 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:09.165323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:09.165814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:09.166974 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:09.167676 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:09.168314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:09.168645 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:09.278711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:09.279424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:09.289000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:09.289499 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:09.289942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:09.290654 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:09.291162 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:09.291589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:09.296289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:09.325892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:09.334298 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2cfc4a1c-a48e-4c6f-914d-0499bbb5be89 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.180223 Aug 10 11:27:09.345732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 296/601] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:09 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:09.428526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:09.436763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:09.442194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:09.442194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d5948c1f-c4e5-4803-b3fa-c27450179896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.166092 Aug 10 11:27:09.442194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 306/602] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:09 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:27:10.357039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:10.357640 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:10.363906 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:10.364416 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:10.364849 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:10.365527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:10.365976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:10.366391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:10.462583 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:10.463249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:10.470343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:10.470843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:10.471254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:10.471976 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:10.472450 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:10.472880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:10.501365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:10.509116 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d63913c9-5304-4826-bea2-446c99e7b1a0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.156129 Aug 10 11:27:10.509808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 297/603] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:10 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:10.617001 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:10.633507 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:10.635645 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:10.636839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5c0714d6-bf2d-4357-95dd-dc458fdf2ad8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.178178 Aug 10 11:27:10.637394 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 307/604] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:10 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:27:11.531340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:11.531945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:11.538970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:11.539453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:11.540713 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:11.541750 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:11.542373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:11.542796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:11.659424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:11.660054 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:11.673272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:11.673272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:11.673272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:11.673272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:11.673757 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:11.673757 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:11.673920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:11.680716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-88cd1d12-76c1-4be7-87ed-7f539077a678 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.153214 Aug 10 11:27:11.681295 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 298/605] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:11 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:11.829427 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:11.837623 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:11.839808 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:11.840981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ad284a4f-d865-413f-9e08-0681b4fd00e6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.185527 Aug 10 11:27:11.841821 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 308/606] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:11 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:27:12.701099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:12.701714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:12.708411 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:12.708892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:12.709328 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:12.710012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:12.710464 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:12.710882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:12.824348 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1968794094"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:12.825130 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:12.832690 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:12.833178 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:12.833617 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:12.834312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:12.834762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:12.835350 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:12.855429 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:12.863746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2c503f77-eafd-48f8-a349-ef8e00539e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.166838 Aug 10 11:27:12.864351 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 299/607] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:12 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:12.870578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:12.871359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:12.877774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:12.891075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:12.891075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:12.891075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:12.891075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:12.891464 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:13.020607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.network.security_group_api [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Adding security group 11004a7c-2f10-471e-99ff-1df8ef0ec485 to port fb19c135-b6e1-4aab-9034-c28ae9b55761 Aug 10 11:27:13.116762 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:13.134518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:13.134518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:13.134518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9ead9b95-cd74-4af4-8f23-7ea9842f3dde tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1738 microversion: 2.20 time: 0.262130 Aug 10 11:27:13.135473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 300/608] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:12 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:13.865706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-75cbd635-4b8b-4db2-92bc-fa4f257ce309 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "POST /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/action" status: 202 len: 0 microversion: 2.1 time: 1.045634 Aug 10 11:27:13.869993 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 309/609] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:27:12 2022] POST /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/action => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:27:13.874655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-11a9afb1-a730-4781-9bf7-ee2053bdf1e9 req-a6082c5f-9be4-4b67-b4d6-8d33fb1219cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34add072-ed4f-4601-b02e-e5b98edbb970", "tag": "fb19c135-b6e1-4aab-9034-c28ae9b55761"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:13.893799 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:13.893799 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:13.925760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:13.926268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:13.926706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:13.927446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:13.927901 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:13.928358 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:13.933828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-11a9afb1-a730-4781-9bf7-ee2053bdf1e9 req-a6082c5f-9be4-4b67-b4d6-8d33fb1219cc service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:13.934312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-11a9afb1-a730-4781-9bf7-ee2053bdf1e9 req-a6082c5f-9be4-4b67-b4d6-8d33fb1219cc service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:13.934740 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-11a9afb1-a730-4781-9bf7-ee2053bdf1e9 req-a6082c5f-9be4-4b67-b4d6-8d33fb1219cc service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:13.956320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-11a9afb1-a730-4781-9bf7-ee2053bdf1e9 req-a6082c5f-9be4-4b67-b4d6-8d33fb1219cc service nova] Creating event network-changed:fb19c135-b6e1-4aab-9034-c28ae9b55761 for instance 34add072-ed4f-4601-b02e-e5b98edbb970 on hv-cinder-85061 Aug 10 11:27:13.964681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-11a9afb1-a730-4781-9bf7-ee2053bdf1e9 req-a6082c5f-9be4-4b67-b4d6-8d33fb1219cc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092344 Aug 10 11:27:13.965906 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 301/610] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:13.971647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:13.972524 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:13.981609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:13.982349 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:13.982952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:13.983816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:13.984509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:13.985208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:14.248515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:14.257493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:14.258223 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-52b678df-52e4-4833-a06b-aae0b46f1a47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.290909 Aug 10 11:27:14.259180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 302/611] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:13 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:14.265381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:14.265999 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:14.272524 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:14.273044 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:14.273487 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:14.274333 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:14.274807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:14.275257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:14.290317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0b79adf0-79df-4fac-9763-3067a8e6edfe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1641 microversion: 2.1 time: 0.413887 Aug 10 11:27:14.292415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 310/612] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:13 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1641 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:14.507751 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:14.517176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:14.533932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:14.533932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e243acf1-20bd-4d96-b2ca-6ffe871b8b23 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1720 microversion: 2.20 time: 0.260027 Aug 10 11:27:14.533932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 303/613] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:14 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:15.280787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:15.281501 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:15.288525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:15.290170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:15.290170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:15.290170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:15.290630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:15.291728 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:15.428119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:15.436897 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9be6dc29-5685-432f-9bf7-b79a90ce0c4d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.159785 Aug 10 11:27:15.437544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 311/614] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:15 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:15.448420 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-6edc7a1b-ea81-4e68-b8d7-a148f8491b95 req-b15b9805-a205-4b0a-82d7-2eb2a464fb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2a390-b869-4d2f-9013-63011c65a796", "name": "network-vif-plugged", "status": "completed", "tag": "0fa11193-0b09-4b89-88fe-421118ac0b2a"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:15.459626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-6edc7a1b-ea81-4e68-b8d7-a148f8491b95 req-b15b9805-a205-4b0a-82d7-2eb2a464fb25 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:15.460207 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-6edc7a1b-ea81-4e68-b8d7-a148f8491b95 req-b15b9805-a205-4b0a-82d7-2eb2a464fb25 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:15.460659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-6edc7a1b-ea81-4e68-b8d7-a148f8491b95 req-b15b9805-a205-4b0a-82d7-2eb2a464fb25 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:15.465122 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:15.472838 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-6edc7a1b-ea81-4e68-b8d7-a148f8491b95 req-b15b9805-a205-4b0a-82d7-2eb2a464fb25 service nova] Creating event network-vif-plugged:0fa11193-0b09-4b89-88fe-421118ac0b2a for instance baf2a390-b869-4d2f-9013-63011c65a796 on hv-cinder-85061 Aug 10 11:27:15.477723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-6edc7a1b-ea81-4e68-b8d7-a148f8491b95 req-b15b9805-a205-4b0a-82d7-2eb2a464fb25 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033187 Aug 10 11:27:15.479098 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 304/615] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:15.544590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:15.545228 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:15.551185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:15.551664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:15.552117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:15.552804 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:15.553253 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:15.566574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:15.691940 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:15.700461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:15.702102 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:15.703601 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b84baec5-964d-491c-8ebe-e7a0f773073a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1720 microversion: 2.20 time: 0.163234 Aug 10 11:27:15.706152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 312/616] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:15 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:16.459770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:16.460500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:16.468251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:16.468659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:16.469086 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:16.469759 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:16.470207 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:16.470621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:16.599397 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:16.606903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-329d7efd-c324-448d-97e2-b5863d1409a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.151589 Aug 10 11:27:16.607456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 305/617] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:16 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:16.732988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:16.732988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:16.734125 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:16.734605 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:16.735039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:16.735723 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:16.736206 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:16.736630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:16.871010 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:16.878830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:16.880324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:16.881460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5abe3092-c612-4b46-8c28-e209d58f09e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1720 microversion: 2.20 time: 0.158345 Aug 10 11:27:16.882012 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 313/618] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:16 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:17.627273 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:17.627775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:17.634149 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:17.635215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:17.636195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:17.636875 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:17.637322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:17.637769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:17.765779 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:17.773277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d05cdf77-2033-4f4f-9505-cac154e0775f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.149933 Aug 10 11:27:17.773839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 306/619] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:17 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:17.905676 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:17.906190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:17.912717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:17.913192 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:17.913622 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:17.914297 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:17.914739 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:17.915158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:18.048241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:18.056183 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:18.058180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:18.059322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0924b7f9-6a36-4275-ba73-d8c3f26e27b2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1720 microversion: 2.20 time: 0.157588 Aug 10 11:27:18.059874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 314/620] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:17 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:18.796025 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:18.796802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:18.803549 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:18.804239 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:18.804695 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:18.805439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:18.805946 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:18.806372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:18.947091 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:18.955301 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b3d1b288-7efc-402c-a6be-1e6356eec4a8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.164019 Aug 10 11:27:18.955677 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 307/621] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:18 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:19.089098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:19.100035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:19.100035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:19.100035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:19.100035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:19.100423 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:19.100423 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:19.100423 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:19.226431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:19.234756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:19.236312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:19.237451 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2bbb83f7-14fc-4089-9426-3e5e7ed40dd4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1720 microversion: 2.20 time: 0.157109 Aug 10 11:27:19.238006 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 315/622] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:19 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:19.977255 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:19.977779 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:19.984668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:19.985136 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:19.985564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:19.986332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:19.986776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:19.987198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:20.128220 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:20.136715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4f5ee598-1c42-4bdb-afa5-b22f0b7f13ae tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.163389 Aug 10 11:27:20.137286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 308/623] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:19 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:20.262073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:20.262620 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:20.268960 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:20.269440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:20.269874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:20.270558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:20.271010 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:20.271433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:20.400073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:20.408329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:20.409861 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:20.411045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e80b90a7-62a8-4782-954c-10972ea0e01d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1720 microversion: 2.20 time: 0.153555 Aug 10 11:27:20.411605 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 316/624] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:20 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:20.788539 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-44e6b26e-91fd-4db6-9aba-2970dd76a738 req-a3c7fcf5-cd76-499b-984a-0f0f8c6ba2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf17719-c01d-4bcc-8a23-83d1a8a1a492", "name": "network-vif-unplugged", "status": "completed", "tag": "4e6451ea-a107-42b4-9e4e-d34766a2f2d9"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:20.797384 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-44e6b26e-91fd-4db6-9aba-2970dd76a738 req-a3c7fcf5-cd76-499b-984a-0f0f8c6ba2f4 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:20.797856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-44e6b26e-91fd-4db6-9aba-2970dd76a738 req-a3c7fcf5-cd76-499b-984a-0f0f8c6ba2f4 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:20.798279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-44e6b26e-91fd-4db6-9aba-2970dd76a738 req-a3c7fcf5-cd76-499b-984a-0f0f8c6ba2f4 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:20.813056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-44e6b26e-91fd-4db6-9aba-2970dd76a738 req-a3c7fcf5-cd76-499b-984a-0f0f8c6ba2f4 service nova] Creating event network-vif-unplugged:4e6451ea-a107-42b4-9e4e-d34766a2f2d9 for instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 on hv-cinder-85061 Aug 10 11:27:20.818085 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-44e6b26e-91fd-4db6-9aba-2970dd76a738 req-a3c7fcf5-cd76-499b-984a-0f0f8c6ba2f4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035116 Aug 10 11:27:20.818691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 309/625] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:21.157644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:21.158258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:21.164556 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:21.165050 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:21.165486 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:21.166186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:21.166666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:21.167089 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:21.295752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:21.303246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cccd061d-1c00-4794-a625-4c6e22cad26c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.149456 Aug 10 11:27:21.303850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 317/626] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:21 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:21.435668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:21.436380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:21.446805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:21.446805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:21.446805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:21.446805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:21.447894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:21.447894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:21.582799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:21.591497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:21.596773 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:21.596773 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-66700dba-0ec5-4f60-a38b-81ecbbfa9f5f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1720 microversion: 2.20 time: 0.164110 Aug 10 11:27:21.596773 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 310/627] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:21 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:22.324544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:22.325155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:22.331680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.332191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.332628 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.333311 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.333762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.334182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.463269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:22.471152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1b9ad2d1-8cee-4155-a75c-cbf1c0af34a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.150367 Aug 10 11:27:22.471648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 318/628] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:22 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:22.617343 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:22.617944 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:22.624506 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.624985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.625420 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.626103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.626556 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.626986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.754430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:22.763009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:22.764546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:22.765699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-534498b0-3877-458c-ba94-2438ff414051 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1723 microversion: 2.20 time: 0.152357 Aug 10 11:27:22.766285 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 311/629] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:22 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:22.799237 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bee97fd-11e5-48bc-8238-2b3b3ab56509"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:22.801705 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:22.808308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.808798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.809211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:22.809901 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:22.810355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:22.810785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:23.491507 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:23.492163 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:23.498251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:23.498734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:23.499163 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:23.499846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:23.500321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:23.511679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:23.633667 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:23.641846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-93cb6ff6-62ed-422a-bca3-54ae11997c5b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.154142 Aug 10 11:27:23.642557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 312/630] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:23 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:27:24.450317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-805aa2b5-3e4d-4e5b-9b19-e106410472d7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.654980 Aug 10 11:27:24.451642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 319/631] 10.222.0.13 () {62 vars in 1364 bytes} [Wed Aug 10 11:27:22 2022] POST /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments => generated 188 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:27:24.575635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:24.576384 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:24.582560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:24.583031 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:24.583460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:24.584171 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:24.584617 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:24.585035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:24.627156 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118426) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:27:24.662646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:24.663284 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:24.669368 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:24.669847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:24.670280 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:24.671025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:24.671475 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:24.671898 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:24.689751 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:24.801362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:24.809091 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f816be57-18f4-4566-a03a-3d7a9d2ec622 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.150379 Aug 10 11:27:24.809656 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 320/632] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:24 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:27:24.990576 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-934e36da-44d1-4ec6-a11e-79ab2b647822 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/action" status: 202 len: 0 microversion: 2.20 time: 0.419375 Aug 10 11:27:24.991438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 313/633] 10.222.0.13 () {62 vars in 1319 bytes} [Wed Aug 10 11:27:24 2022] POST /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:27:24.999786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:25.000420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:25.007043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:25.007526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:25.008137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:25.008826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:25.009278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:25.009702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:25.143845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:25.152790 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:25.154267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:25.155459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7ea66e49-0af9-4b60-903c-6d92917a2a9d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1809 microversion: 2.20 time: 0.159607 Aug 10 11:27:25.156016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 321/634] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:24 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:25.830769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:25.831381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:25.837548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:25.838129 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:25.838726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:25.839420 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:25.839870 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:25.840324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:25.982827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:25.990565 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-771a5c87-1e51-49bd-acd1-85069dbedcb6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.164566 Aug 10 11:27:25.991372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 314/635] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:25 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:26.178468 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:26.179074 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:26.186365 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:26.186853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:26.187289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:26.187982 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:26.188453 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:26.188877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:26.345196 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:26.354046 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:26.355745 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:26.357061 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ffaf458f-4d2a-44f1-b446-e4f926f38288 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1809 microversion: 2.20 time: 0.182374 Aug 10 11:27:26.357624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 322/636] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:26 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:27.013357 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:27.013891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:27.020249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:27.020729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:27.021159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:27.021839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:27.022291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:27.022710 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:27.204880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:27.212231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-760931c3-1578-4c2c-adc0-e5349d3a7cb1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.203374 Aug 10 11:27:27.213498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 315/637] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:27 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:27.380092 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:27.380701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:27.388305 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:27.388788 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:27.389211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:27.389888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:27.390338 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:27.390755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:27.570513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:27.579909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:27.581406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:27.582541 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a48f3fdb-af7d-480d-8f60-c87bd62ca328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1809 microversion: 2.20 time: 0.206327 Aug 10 11:27:27.583098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 323/638] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:27 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:28.233846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:28.234990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:28.242016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:28.242488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:28.242912 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:28.243582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:28.244801 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:28.245236 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:28.375488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:28.389075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7bab0675-4997-4552-8d19-8c025d80ae63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.158969 Aug 10 11:27:28.389663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 316/639] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:28 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:28.605582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:28.606247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:28.612824 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:28.613305 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:28.613766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:28.614456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:28.614909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:28.615335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:28.750137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:28.758306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:28.759912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:28.761097 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-22fd1908-cf0a-4d1f-bb0a-0a2230bae2be tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1809 microversion: 2.20 time: 0.160085 Aug 10 11:27:28.761658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 324/640] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:28 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:29.409620 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:29.410146 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:29.416752 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:29.417228 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:29.417662 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:29.418342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:29.418792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:29.419218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:29.562130 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:29.570057 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f0cafe11-7909-4ae6-ab86-ef2b8193cd74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.164388 Aug 10 11:27:29.579936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 317/641] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:29 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:29.784975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:29.786084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:29.787603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=54 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:29.792636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:29.793142 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:29.793576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:29.794267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:29.794722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:29.795197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:29.929875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:29.939312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:29.940850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:29.942004 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6df7438e-8b6c-4870-8339-3cdf0ac054d4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1751 microversion: 2.20 time: 0.161502 Aug 10 11:27:29.942551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 325/642] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:29 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:30.592832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:30.593442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:30.599851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:30.600368 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:30.600805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:30.601490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:30.601943 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:30.602368 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:30.733427 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:30.741180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5672a37a-11f3-4217-97f5-c3377a79d93b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.152210 Aug 10 11:27:30.741746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 318/643] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:30 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:30.966294 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:30.966830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:30.973191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:30.973671 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:30.974101 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:30.974786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:30.975232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:30.975653 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:31.106181 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:31.114426 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:31.115913 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:31.117062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e4ca7be9-409b-45b7-a515-41a7fcc7b169 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1751 microversion: 2.20 time: 0.154893 Aug 10 11:27:31.117612 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 326/644] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:30 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:31.762315 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:31.762905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:31.769222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:31.769693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:31.770119 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:31.770787 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:31.771263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:31.771673 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:31.902156 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:31.909522 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c757c3e9-3cf8-4120-8c68-c95794a5435c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.151627 Aug 10 11:27:31.910084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 319/645] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:31 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:32.139315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:32.139916 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:32.146293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:32.146783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:32.147218 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:32.147904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:32.148386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:32.148815 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:32.277752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:32.286064 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:32.287557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:32.288740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0e52cf62-dfb4-4540-9c1d-82c9d2a6848c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1751 microversion: 2.20 time: 0.153383 Aug 10 11:27:32.289296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 327/646] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:32 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:32.930823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:32.932442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:32.938788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:32.939259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:32.939684 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:32.940385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:32.940830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:32.941248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:33.072426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:33.080076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3c6ce319-884c-423b-829a-29e96983d20f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.153089 Aug 10 11:27:33.080638 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 320/647] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:32 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:33.311064 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:33.311668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:33.317982 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:33.318462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:33.318894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:33.319608 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:33.320039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:33.320466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:33.452764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:33.461388 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:33.463547 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:33.464731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3a2d58cd-486a-4afd-8cfa-869b78f3798a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1751 microversion: 2.20 time: 0.158099 Aug 10 11:27:33.465297 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 328/648] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:33 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:34.101733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:34.102343 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:34.109002 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:34.109479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:34.109909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:34.110643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:34.111090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:34.111509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:34.115571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:34.242518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:34.250465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9e2ea1df-6b9d-41b0-b680-73ac072b4899 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.152580 Aug 10 11:27:34.252625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 321/649] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:34 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:34.487800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:34.488436 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:34.495419 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:34.495896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:34.496356 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:34.497070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:34.497522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:34.497949 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:34.629009 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:34.637496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:34.638981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:34.640153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7b0c3e41-2b99-4d41-af06-21c907c2f8a5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1751 microversion: 2.20 time: 0.156194 Aug 10 11:27:34.640706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 329/650] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:34 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:35.272221 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:35.272823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:35.280533 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:35.281015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:35.281441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:35.282118 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:35.282589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:35.283007 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:35.416937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:35.424566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-07d78a4f-9c3f-4f52-a1a8-b8ba5d99ccd3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1367 microversion: 2.1 time: 0.156488 Aug 10 11:27:35.425147 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 322/651] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:35 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:35.662650 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:35.663244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:35.670309 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:35.672912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:35.672912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:35.672912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:35.672912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:35.673279 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:35.801093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:35.810419 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:35.816302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:35.816302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8588f6bc-5eb9-4a5b-8fa7-fee7ab4f84d5 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1751 microversion: 2.20 time: 0.154267 Aug 10 11:27:35.816302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 330/652] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:35 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:36.445261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:36.445876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:36.448464 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:36.453281 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:36.454021 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:36.454460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:36.455182 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:36.455657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:36.456124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:36.598467 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:36.608833 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6e725a36-f9bf-486b-842b-b5310c83cf6a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1557 microversion: 2.1 time: 0.167298 Aug 10 11:27:36.622366 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 323/653] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:27:36 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:27:36.629400 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:36.630616 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:36.636747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:36.638259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:36.638259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:36.638496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:36.638832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:36.639628 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:36.723894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ac53c4c7-04da-487b-895e-298174ccc827 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098377 Aug 10 11:27:36.735617 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 331/654] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 10 11:27:36 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:36.837602 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:36.838784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:36.844967 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:36.850172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:36.850172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:36.850172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:36.850172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:36.850639 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:36.984883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:36.993596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:36.995437 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:36.996641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ba4819f6-248e-460c-ac36-d2d61a789533 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1751 microversion: 2.20 time: 0.163314 Aug 10 11:27:36.997202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 324/655] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:36 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:37.818729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-fc3016a2-fd04-48a7-bab7-2fea816bfba6 req-95e15f80-38f3-4593-841b-282aefae37ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf2a390-b869-4d2f-9013-63011c65a796", "tag": "0fa11193-0b09-4b89-88fe-421118ac0b2a"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:27:37.832737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-fc3016a2-fd04-48a7-bab7-2fea816bfba6 req-95e15f80-38f3-4593-841b-282aefae37ce service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:37.835230 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-fc3016a2-fd04-48a7-bab7-2fea816bfba6 req-95e15f80-38f3-4593-841b-282aefae37ce service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:37.835670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-fc3016a2-fd04-48a7-bab7-2fea816bfba6 req-95e15f80-38f3-4593-841b-282aefae37ce service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:37.913075 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-fc3016a2-fd04-48a7-bab7-2fea816bfba6 req-95e15f80-38f3-4593-841b-282aefae37ce service nova] Creating event network-changed:0fa11193-0b09-4b89-88fe-421118ac0b2a for instance baf2a390-b869-4d2f-9013-63011c65a796 on hv-cinder-85061 Aug 10 11:27:37.919414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-fc3016a2-fd04-48a7-bab7-2fea816bfba6 req-95e15f80-38f3-4593-841b-282aefae37ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108319 Aug 10 11:27:37.920084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 332/656] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:27:38.020458 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:38.021370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:38.029648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:38.030259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:38.030900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:38.031778 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:38.032365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:38.032890 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:38.167409 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:38.175753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:38.177288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:38.178438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-004fea08-413b-4eb5-acc1-41ee0f2420e3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.162302 Aug 10 11:27:38.178996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 325/657] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:38 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:39.202478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:39.204561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:39.209486 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:39.209971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:39.210409 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:39.211093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:39.211547 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:39.211972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:39.413866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:39.423374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:39.424926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:39.428135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5e9d6044-1921-4e48-b37d-7b2f16e9de00 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.228253 Aug 10 11:27:39.428135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 333/658] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:39 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:40.109705 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:40.110421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:40.116880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:40.117359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:40.117790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:40.118474 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:40.120119 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:40.125771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:40.247922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lazy-loading 'services' on Instance uuid 76385e9f-c2f0-4102-a711-2c59ab9864ac {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:27:40.450895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:40.451529 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:40.458335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:40.458814 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:40.459248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:40.459972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:40.460447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:40.460872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:40.610327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d0d0a5fb-5b91-4877-9058-4ac5288d4d6d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "DELETE /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac/os-volume_attachments/231d8b25-0749-4da7-b84e-cfa528bd7995" status: 202 len: 0 microversion: 2.1 time: 0.504828 Aug 10 11:27:40.611627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 326/659] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:27:40 2022] DELETE /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac/os-volume_attachments/231d8b25-0749-4da7-b84e-cfa528bd7995 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:27:40.622576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:40.639789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:40.641597 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:40.642930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9fe9993b-4893-4ef2-88eb-0cdb1efe9ae0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.196728 Aug 10 11:27:40.659638 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 334/660] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:40 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:27:41.667784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:41.668430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:41.674585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:41.675064 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:41.675496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:41.676212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:41.676663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:41.677101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:41.813225 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:41.821636 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:41.824398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:41.825543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9e4a69c3-ba88-4cfb-927a-0303ac43956c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.162663 Aug 10 11:27:41.826101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 327/661] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:41 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:42.848974 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:42.849731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:42.857034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:42.857517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:42.857951 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:42.858633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:42.859083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:42.859535 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:42.992501 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:43.004503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:43.005973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:43.007155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-202f80a2-e485-42c5-b9a0-2b90206f9bc1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.162094 Aug 10 11:27:43.007712 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 335/662] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:42 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:44.134101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:44.134741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:44.140972 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:44.141465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:44.141894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:44.142589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:44.143037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:44.143462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:44.288573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:44.297215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:44.298699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:44.299835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-39280a2f-1b72-451d-9daa-cd6d09a6f9c3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.272322 Aug 10 11:27:44.300425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 328/663] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:44 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:44.446591 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:27:44.447586 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:27:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:27:45.324481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:45.325470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:45.333172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:45.333795 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:45.334272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:45.335101 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:45.335671 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:45.336234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:45.470645 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:45.479461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:45.488335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:45.488335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0320ac2a-34e0-4c10-94c5-72b77f6bc41f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.163043 Aug 10 11:27:45.488335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 336/664] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:45 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:46.510481 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:46.511115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:46.517528 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:46.518006 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:46.518440 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:46.519121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:46.519569 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:46.519988 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:46.667893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:46.684389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:46.687536 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:46.690045 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6e3e6666-9858-4998-a21c-c1cb3071a626 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.183810 Aug 10 11:27:46.699581 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 329/665] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:46 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:47.729443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:47.737471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:47.737471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:47.737471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:47.737471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:47.737948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:47.738395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:47.738814 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:47.879928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:47.892039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:47.892039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:47.892039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5207aba9-85d0-4145-bfbf-eee52c8ec67b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.167047 Aug 10 11:27:47.892475 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 337/666] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:47 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:48.914646 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:48.915208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:48.922368 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:48.922848 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:48.923304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:48.923987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:48.924460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:48.924880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:49.060868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:49.069102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:49.070573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:49.071766 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f94b3fb2-fbc2-497b-bee3-641743c5f0db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.161112 Aug 10 11:27:49.072823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 330/667] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:48 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:50.095824 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:50.096465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:50.104142 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:50.104884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:50.105506 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:50.106363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:50.107003 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:50.107616 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:50.141433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:27:50.286364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:50.293833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:50.296347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:50.298142 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d694d26f-9818-4cef-b080-3d91bc9fba28 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.206320 Aug 10 11:27:50.299074 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 338/668] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:50 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:51.321392 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:51.322804 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:51.329650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:51.330121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:51.330556 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:51.331232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:51.331679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:51.332121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:51.471250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:51.480972 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:51.482477 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:51.483642 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a5826970-3d78-4308-880d-8f14285524b0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.166231 Aug 10 11:27:51.484419 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 331/669] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:51 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:52.507090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:52.509119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:52.517890 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:52.518373 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:52.518796 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:52.519484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:52.519936 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:52.520415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:52.656096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:52.663277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:52.664802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:52.666054 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4fb4a6f5-6eba-424d-b3db-55ab48300c0a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.162819 Aug 10 11:27:52.666843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 339/670] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:52 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:53.689184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:53.689746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:53.695827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:53.698569 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:53.698569 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:53.699133 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:53.699608 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:53.700057 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:53.835552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:53.844735 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:53.846213 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:53.847344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-88777e0d-c696-4b4f-ae2e-e0c52eb54ccc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.162358 Aug 10 11:27:53.847902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 332/671] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:53 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:54.869685 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:54.870291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:54.876875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:54.877355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:54.877817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:54.878527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:54.878982 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:54.879409 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:55.011498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:55.019858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:55.021377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:55.022539 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5bafb272-63f8-41cd-9ac2-d8ce31a600ef tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.156778 Aug 10 11:27:55.023088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 340/672] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:54 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:56.047147 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:56.047694 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:56.055159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:56.055640 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:56.056102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:56.056786 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:56.057275 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:56.057694 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:56.189514 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:56.198311 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:56.199805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:56.200972 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-36f86e9f-4dd9-4cd0-b28a-3efcd51b0d6b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.158738 Aug 10 11:27:56.201520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 333/673] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:56 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:57.224444 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:57.225118 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:57.231782 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:57.232308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:57.232748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:57.233466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:57.233920 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:57.234344 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:57.360086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:57.368427 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:57.370513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:57.371662 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6f8f72eb-f2c3-4b52-b157-1813941893ec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.151100 Aug 10 11:27:57.372249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 341/674] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:57 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:27:58.394367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:58.394981 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:58.402141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:58.402611 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:58.403042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:58.403724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:58.404199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:58.404622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:58.535833 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:58.544354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:58.545842 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:58.546989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e8a288a1-303b-44b7-b2d5-4211a683d46a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.156504 Aug 10 11:27:58.547546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 334/675] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:58 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:27:59.569639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:27:59.570237 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:27:59.576903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:59.577389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:59.577822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:59.578494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:27:59.579192 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:27:59.579610 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:27:59.711142 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:59.720331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:59.721831 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:27:59.723028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-11b25642-0710-469a-88d3-4938173f16d8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.157372 Aug 10 11:27:59.723586 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 342/676] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:27:59 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:00.746106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:00.746710 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:00.753351 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:00.753812 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:00.754239 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:00.754912 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:00.755385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:00.755799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:00.891657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:00.899977 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:00.901717 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:00.902950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-291730ab-2acc-4960-851f-6bbb5d11e208 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.161220 Aug 10 11:28:00.903503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 335/677] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:00 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:01.926675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:01.927315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:01.929787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=36 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:01.935111 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:01.935592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:01.936045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:01.936759 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:01.937213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:01.937638 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.052439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:02.052998 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:02.059487 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.059971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.060441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.061131 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.061586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.062058 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.072308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:02.083552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:02.085301 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:02.086480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-73cc877e-4817-4449-989d-cfe298f419bb tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.163714 Aug 10 11:28:02.087042 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 343/678] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:01 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:02.091779 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:28:02.108606 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:02.479390 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-625603d6-95f0-4703-9d25-5a93bffca832 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "DELETE /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 204 len: 0 microversion: 2.1 time: 0.430361 Aug 10 11:28:02.479982 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 336/679] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:28:02 2022] DELETE /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:28:02.488484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:02.489091 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:02.495550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.495971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.496434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.497121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:02.497576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:02.498013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:02.626893 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:02.634437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-bc59e399-dde3-4a32-9582-00ccc64ad2c9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1514 microversion: 2.1 time: 0.149822 Aug 10 11:28:02.635061 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 344/680] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:02 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:03.115018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:03.115823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:03.122910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:03.123386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:03.123816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:03.124530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:03.124978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:03.125399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:03.477404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:03.486060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:03.487551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:03.488724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1af04212-be32-4fe6-9d6b-c68f12430b18 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.378125 Aug 10 11:28:03.489284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 337/681] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:03 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:03.656101 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:03.656646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:03.663240 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:03.663716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:03.664202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:03.664886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:03.665363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:03.665782 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:03.796119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:03.803372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-20431f86-d5be-49b7-80e7-2e773c67a19b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1514 microversion: 2.1 time: 0.152644 Aug 10 11:28:03.803927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 345/682] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:03 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:04.511983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:04.512541 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:04.518830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:04.519304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:04.519729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:04.520433 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:04.520876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:04.521308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:04.653634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:04.662025 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:04.663519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:04.664698 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8becf085-72c6-4410-a6ce-767ac3dae8dc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.157418 Aug 10 11:28:04.665255 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 338/683] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:04 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:04.825896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:04.826504 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:04.833073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:04.833556 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:04.833987 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:04.834669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:04.835118 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:04.835542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:04.965412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:04.973021 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d9b36daa-da1a-41f4-b032-d0f9fb0be0e2 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1514 microversion: 2.1 time: 0.151689 Aug 10 11:28:04.973597 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 346/684] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:04 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:05.686909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:05.687533 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:05.693999 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:05.694505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:05.694941 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:05.695623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:05.696099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:05.696527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:05.830365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:05.839599 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:05.841055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:05.842214 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8712f9e3-d7de-4d39-b307-c964dbd8fc3b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.159421 Aug 10 11:28:05.842771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 339/685] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:05 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:05.995483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:05.996114 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:06.002387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:06.002862 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:06.003294 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:06.003971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:06.004443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:06.004863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:06.133966 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:06.142159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3b353e84-eb3f-4284-866f-9c012e25ec46 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1514 microversion: 2.1 time: 0.151061 Aug 10 11:28:06.142719 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 347/686] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:05 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:06.864475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:06.865088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:06.871921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:06.872436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:06.872871 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:06.873553 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:06.874001 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:06.874423 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:07.006954 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:07.015854 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:07.017384 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:07.018528 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-36cb2c90-f233-4d60-b1c5-e5225838a071 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.157981 Aug 10 11:28:07.019092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 340/687] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:06 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:07.163205 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:07.163745 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:07.170185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:07.170671 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:07.171133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:07.171816 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:07.172355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:07.172779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:07.367446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:07.375268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cb9d8a84-d399-4428-b43d-15f435a0b725 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1514 microversion: 2.1 time: 0.216071 Aug 10 11:28:07.375842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 348/688] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:07 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:07.952255 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-6b631222-be64-4e2a-b020-e59abbbd6a1c req-025f225d-e805-4f70-9f0f-218b03dc87bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76385e9f-c2f0-4102-a711-2c59ab9864ac", "name": "network-vif-deleted", "tag": "f5cb46a9-c2a3-45ee-9134-1e1c21f48e97"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:07.961894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-6b631222-be64-4e2a-b020-e59abbbd6a1c req-025f225d-e805-4f70-9f0f-218b03dc87bf service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:07.962436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-6b631222-be64-4e2a-b020-e59abbbd6a1c req-025f225d-e805-4f70-9f0f-218b03dc87bf service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:07.962946 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-6b631222-be64-4e2a-b020-e59abbbd6a1c req-025f225d-e805-4f70-9f0f-218b03dc87bf service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:07.973547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-6b631222-be64-4e2a-b020-e59abbbd6a1c req-025f225d-e805-4f70-9f0f-218b03dc87bf service nova] Creating event network-vif-deleted:f5cb46a9-c2a3-45ee-9134-1e1c21f48e97 for instance 76385e9f-c2f0-4102-a711-2c59ab9864ac on hv-cinder-85061 Aug 10 11:28:07.979929 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-6b631222-be64-4e2a-b020-e59abbbd6a1c req-025f225d-e805-4f70-9f0f-218b03dc87bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084791 Aug 10 11:28:07.980533 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 341/689] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:28:08.042498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:08.043033 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:08.049346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:08.049908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:08.050406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:08.051113 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:08.051568 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:08.051991 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:08.189136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:08.198130 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:08.199656 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:08.200853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6d0c3c17-b1aa-4f25-95f4-cd2228730883 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.163000 Aug 10 11:28:08.201406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 349/690] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:08 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:08.397734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:08.398424 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:08.405395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:08.405870 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:08.406299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:08.406973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:08.407441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:08.407858 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:08.475693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:08.485389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a51b27c0-85c3-49f7-9102-67c03219faff tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 200 len: 1304 microversion: 2.1 time: 0.091741 Aug 10 11:28:08.486109 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 342/691] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:08 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:09.224894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:09.225499 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:09.232471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:09.232952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:09.233379 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:09.234060 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:09.234506 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:09.234914 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:09.366558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:09.375725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:09.377213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:09.378353 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-257cf244-7279-4e86-a090-855f6677839b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.157582 Aug 10 11:28:09.378904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 350/692] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:09 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:09.506767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:09.507290 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: 76385e9f-c2f0-4102-a711-2c59ab9864ac] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:09.513719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:09.514204 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:09.514635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:09.515324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:09.515771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:09.516235 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:09.530538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] HTTP exception thrown: Instance 76385e9f-c2f0-4102-a711-2c59ab9864ac could not be found. Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Request method failure captured: Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac HTTP/1.1 Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85WVtwEQa9abG8wQV4fcPE9VPxVzFuKCKhwD13tjSGqE-9ruXsNyUYBIvpfTrT_5x1JE-5ZrKB7HUSTnIE0MD_vY79KV_T4FmERv47PyooHy61wD7a9jwN6LSdUmCwPUDsBgm3TczG8UTuwYBJRC1v9bKrODfFwFe3jeYPU53Mq5Nck Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 049e0892819c4a07b79c39737548839d Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1788879536 Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:28:09.532250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/049e0892819c4a07b79c39737548839d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/049e0892819c4a07b79c39737548839d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/049e0892819c4a07b79c39737548839d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_049e0892819c4a07b79c39737548839d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesSnapshotTestJSON-1788879536 Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 049e0892819c4a07b79c39737548839d Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1788879536 Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesSnapshotTestJSON-1788879536-project Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 687fc77f37c54cd5a4503723ae59a082 Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesSnapshotTestJSON-1788879536-project Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 76385e9f-c2f0-4102-a711-2c59ab9864ac could not be found. Aug 10 11:28:09.533905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '76385e9f-c2f0-4102-a711-2c59ab9864ac'} Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76385e9f-c2f0-4102-a711-2c59ab9864ac could not be found. Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:28:09.534952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76385e9f-c2f0-4102-a711-2c59ab9864ac could not be found. Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76385e9f-c2f0-4102-a711-2c59ab9864ac could not be found. Aug 10 11:28:09.536282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:28:09.537327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Returning 404 to user: Instance 76385e9f-c2f0-4102-a711-2c59ab9864ac could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:28:09.537327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3622533f-775a-4324-8245-9a0834bd3825 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac" status: 404 len: 111 microversion: 2.1 time: 0.030796 Aug 10 11:28:09.537327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 343/693] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:09 2022] GET /compute/v2.1/servers/76385e9f-c2f0-4102-a711-2c59ab9864ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:28:10.074195 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-f301ab62-b5aa-410e-8f0e-8b81ca3882b3 req-6fc04918-2e04-48f3-b333-10294dec7097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf17719-c01d-4bcc-8a23-83d1a8a1a492", "name": "network-vif-plugged", "status": "completed", "tag": "4e6451ea-a107-42b4-9e4e-d34766a2f2d9"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:10.083746 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f301ab62-b5aa-410e-8f0e-8b81ca3882b3 req-6fc04918-2e04-48f3-b333-10294dec7097 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:10.084262 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f301ab62-b5aa-410e-8f0e-8b81ca3882b3 req-6fc04918-2e04-48f3-b333-10294dec7097 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:10.084686 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f301ab62-b5aa-410e-8f0e-8b81ca3882b3 req-6fc04918-2e04-48f3-b333-10294dec7097 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:10.104546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-f301ab62-b5aa-410e-8f0e-8b81ca3882b3 req-6fc04918-2e04-48f3-b333-10294dec7097 service nova] Creating event network-vif-plugged:4e6451ea-a107-42b4-9e4e-d34766a2f2d9 for instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 on hv-cinder-85061 Aug 10 11:28:10.104546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-f301ab62-b5aa-410e-8f0e-8b81ca3882b3 req-6fc04918-2e04-48f3-b333-10294dec7097 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030615 Aug 10 11:28:10.104546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 351/694] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:28:10.401795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:10.402395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:10.404334 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:10.409143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:10.409651 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:10.410078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:10.410785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:10.411230 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:10.411647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:10.539977 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:10.549171 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:10.550651 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:10.551775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e7ea28f4-04e2-4e4d-a664-3d90e672e707 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.154624 Aug 10 11:28:10.552358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 344/695] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:10 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:11.575737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:11.576486 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:11.582772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:11.583284 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:11.583720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:11.584436 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:11.584888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:11.585314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:11.722671 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:11.731494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:11.732995 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:11.734190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-da6002b8-c7ae-42b3-8e25-b61050c6267b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.163138 Aug 10 11:28:11.734749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 352/696] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:11 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:12.757652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:12.758179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:12.765607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:12.766081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:12.766514 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:12.767189 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:12.767630 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:12.768073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:12.897828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:12.907309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:12.908828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:12.909969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6e740f93-e007-4318-9689-6ed900c19c96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.156338 Aug 10 11:28:12.910518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 345/697] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:12 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:13.933899 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:13.934499 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:13.941110 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:13.941591 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:13.942025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:13.942709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:13.943164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:13.943587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:14.074247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:14.083053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:14.084561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:14.085709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-96be1530-d044-457c-a9bd-a89b3e6ff322 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.155766 Aug 10 11:28:14.086262 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 353/698] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:13 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:15.109417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:15.110016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:15.116444 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:15.116914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:15.117340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:15.118017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:15.118461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:15.118876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:15.248332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:15.256697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:15.258183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:15.259375 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-468a9cb2-382e-4236-b9c6-5a91f1d01c2a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.153812 Aug 10 11:28:15.260090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 346/699] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:15 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:16.282310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:16.282950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:16.289167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:16.289647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:16.290083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:16.290768 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:16.291716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:16.292191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:16.429917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:16.440169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:16.441691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:16.442829 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-88718a55-8170-4ace-b947-0a19f4160c78 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.164378 Aug 10 11:28:16.443375 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 354/700] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:16 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:17.466183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:17.466822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:17.473427 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:17.473908 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:17.474347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:17.475033 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:17.475483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:17.475907 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:17.606164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:17.614674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:17.616188 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:17.617401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-677e4052-8fe0-4d6a-9459-ef401dae7ffc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.155394 Aug 10 11:28:17.617962 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 347/701] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:17 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:18.641737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:18.642343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:18.648861 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:18.649519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:18.649965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:18.651404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:18.651861 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:18.652311 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:18.675678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:18.811611 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:18.820245 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:18.821731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:18.823802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d301d83c-805b-4b35-a484-73bb9fd396e1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.186712 Aug 10 11:28:18.824391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 355/702] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:18 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:19.846682 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:19.847281 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:19.855422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:19.855940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:19.856399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:19.857073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:19.857519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:19.857935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:19.991284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:20.000541 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:20.003482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:20.003482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-12fbaef3-0ff8-46d8-9a89-2e593aee7b3a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.160478 Aug 10 11:28:20.003980 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 348/703] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:19 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:21.025847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:21.026427 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:21.032849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:21.033325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:21.033762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:21.034448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:21.034895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:21.035317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:21.164473 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:21.172929 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:21.174432 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:21.175579 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-08fe5e70-fcca-42b3-a87e-1a0a57d994d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.153629 Aug 10 11:28:21.176159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 356/704] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:21 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:22.199489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:22.200342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:22.206600 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:22.207084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:22.207516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:22.208223 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:22.208674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:22.209093 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:22.350544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:22.360566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:22.362218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:22.363428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9e577d69-fb8f-4714-a3df-d584370cd740 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1807 microversion: 2.20 time: 0.168622 Aug 10 11:28:22.364055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 349/705] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:22 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:23.387062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:23.387763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:23.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:23.394862 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:23.395296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:23.395988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:23.396463 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:23.396887 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:23.437782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1392558224", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "networks": [{"uuid": "b0311c2f-c020-471c-8a70-8d7130b50197"}]}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:23.493258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] validate_networks() for [('b0311c2f-c020-471c-8a70-8d7130b50197', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:28:23.588513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:23.596975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:23.598452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:23.599594 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8bd5ce76-892b-423f-8d97-1d24db32caf3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1794 microversion: 2.20 time: 0.217226 Aug 10 11:28:23.600183 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 357/706] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:28:23 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1794 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:28:23.912236 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:28:23.912655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:28:23.913153 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:28:23.913557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:28:23.913961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:28:23.923422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:23.923895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:23.924353 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:23.925065 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:23.925516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:23.925930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:23.943735 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Getting quotas for project 049e0892819c4a07b79c39737548839d. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:28:23.947925 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Getting quotas for user 687fc77f37c54cd5a4503723ae59a082 and project 049e0892819c4a07b79c39737548839d. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:28:23.958773 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:28:23.961004 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:28:24.130610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-365a201e-172c-4249-a3b6-44c004bea41c tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696587 Aug 10 11:28:24.131385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 350/707] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:28:24.142247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-14dd7483-c4ac-4ace-b23e-f9d907be98a0 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:24.146688 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-14dd7483-c4ac-4ace-b23e-f9d907be98a0 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:24.194618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-14dd7483-c4ac-4ace-b23e-f9d907be98a0 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:24.201186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-14dd7483-c4ac-4ace-b23e-f9d907be98a0 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1219 microversion: 2.1 time: 0.062888 Aug 10 11:28:24.201803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 358/708] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:24 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:25.222060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9133ec57-6beb-42e9-b336-0c46baf5abbf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:25.222672 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9133ec57-6beb-42e9-b336-0c46baf5abbf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:25.275009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9133ec57-6beb-42e9-b336-0c46baf5abbf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:25.281733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9133ec57-6beb-42e9-b336-0c46baf5abbf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1219 microversion: 2.1 time: 0.063722 Aug 10 11:28:25.282291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 351/709] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:25 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:28:26.302563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:26.303235 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:26.310145 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:26.310649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:26.311072 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:26.311762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:26.312241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:26.312666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:26.373579 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:26.380981 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-34e5396c-5d35-4099-ac79-327d0fcc0a50 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1271 microversion: 2.1 time: 0.082259 Aug 10 11:28:26.381542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 359/710] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:26 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:27.402980 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:27.403579 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:27.410024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:27.410497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:27.410922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:27.411596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:27.412064 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:27.412485 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:27.475860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:27.484045 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-adfb1be3-7166-440f-965a-172f81b60b0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1277 microversion: 2.1 time: 0.085472 Aug 10 11:28:27.486596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 352/711] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:27 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:28.505580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:28.506136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:28.512973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:28.513481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:28.513910 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:28.514582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:28.515029 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:28.515446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:28.658504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-a1f4b9a8-ed36-4bfc-87e9-0e308708234b req-dfc210d9-14bc-413a-9c19-da4f00925adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c", "tag": "65ff0911-3286-4aa6-a533-6cf95b4e0c9d"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:28.660296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:28.669389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ad1c9da0-a74f-4b70-ad6f-8b2eb93a564e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.167566 Aug 10 11:28:28.670226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 360/712] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:28 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:28.670374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-a1f4b9a8-ed36-4bfc-87e9-0e308708234b req-dfc210d9-14bc-413a-9c19-da4f00925adb service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:28.670923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-a1f4b9a8-ed36-4bfc-87e9-0e308708234b req-dfc210d9-14bc-413a-9c19-da4f00925adb service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:28.671463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-a1f4b9a8-ed36-4bfc-87e9-0e308708234b req-dfc210d9-14bc-413a-9c19-da4f00925adb service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:28.684470 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-a1f4b9a8-ed36-4bfc-87e9-0e308708234b req-dfc210d9-14bc-413a-9c19-da4f00925adb service nova] Creating event network-changed:65ff0911-3286-4aa6-a533-6cf95b4e0c9d for instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c on hv-cinder-85061 Aug 10 11:28:28.689511 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-a1f4b9a8-ed36-4bfc-87e9-0e308708234b req-dfc210d9-14bc-413a-9c19-da4f00925adb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034808 Aug 10 11:28:28.690097 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 353/713] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:28:29.690894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:29.691431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:29.698532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:29.699013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:29.699447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:29.700168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:29.700620 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:29.701043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:29.833767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:29.841764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0b67ed68-e38b-44e1-994d-aa50f5f418bc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.154778 Aug 10 11:28:29.842321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 361/714] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:29 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:30.863621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:30.864342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:30.870592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:30.871068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:30.871498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:30.872215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:30.872687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:30.873088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:31.003860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:31.011597 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-356c7317-ef05-4e81-a42a-e232614d42a3 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.152669 Aug 10 11:28:31.012242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 354/715] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:30 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:32.032356 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:32.032957 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:32.035269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=40 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:32.039905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:32.040407 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:32.041488 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:32.042136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:32.042582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:32.043044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:32.170184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:32.177660 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-02caf8d5-86fd-4f05-ae21-be3266440fdf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.149261 Aug 10 11:28:32.178227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 362/716] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:32 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:33.199371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:33.199979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:33.206729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:33.207206 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:33.207636 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:33.208344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:33.208792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:33.209211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:33.211827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:33.340687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:33.348475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-26a4ce48-362c-46b6-a6e8-98b97c325f9b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.153561 Aug 10 11:28:33.349041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 355/717] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:33 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:28:34.370471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:34.371079 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:34.373447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:34.378126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:34.378606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:34.379041 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:34.379789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:34.380276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:34.380707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:34.509244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:34.516976 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5c746b88-2e75-4d18-8ada-f01d6ac99b95 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.150922 Aug 10 11:28:34.517531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 363/718] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:34 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:28:35.537761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:35.538306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:35.540304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:35.542020 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=8 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:35.546688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:35.547159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:35.547585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:35.548294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:35.548736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:35.549152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:35.683988 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:35.692243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6f0ea4ce-02c9-4aac-a0f9-3a69aae7e8be tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.158357 Aug 10 11:28:35.692806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 356/719] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:35 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:36.715132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:36.715958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:36.722466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:36.723058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:36.723505 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:36.724232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:36.724692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:36.725129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:36.950466 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-632e0247-bb39-41d1-bd5d-d920ba6f4beb req-5f2596e2-7d0e-4d61-893e-25b8e8623cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c", "name": "network-vif-plugged", "status": "completed", "tag": "65ff0911-3286-4aa6-a533-6cf95b4e0c9d"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:36.960566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-632e0247-bb39-41d1-bd5d-d920ba6f4beb req-5f2596e2-7d0e-4d61-893e-25b8e8623cd2 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:36.961039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-632e0247-bb39-41d1-bd5d-d920ba6f4beb req-5f2596e2-7d0e-4d61-893e-25b8e8623cd2 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:36.961464 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-632e0247-bb39-41d1-bd5d-d920ba6f4beb req-5f2596e2-7d0e-4d61-893e-25b8e8623cd2 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:36.973365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-632e0247-bb39-41d1-bd5d-d920ba6f4beb req-5f2596e2-7d0e-4d61-893e-25b8e8623cd2 service nova] Creating event network-vif-plugged:65ff0911-3286-4aa6-a533-6cf95b4e0c9d for instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c on hv-cinder-85061 Aug 10 11:28:36.979086 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-632e0247-bb39-41d1-bd5d-d920ba6f4beb req-5f2596e2-7d0e-4d61-893e-25b8e8623cd2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091140 Aug 10 11:28:36.979703 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 357/720] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:28:37.167514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:37.175168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7a1c3eb7-602f-427a-9231-d069e6cd098b tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.464473 Aug 10 11:28:37.175819 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 364/721] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:36 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:38.198465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:38.199195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:38.206096 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:38.206581 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:38.207019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:38.207709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:38.208266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:38.208697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:38.340622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:38.347878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-51d8b092-5a49-40a9-bbc0-01dfd4db81da tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.154403 Aug 10 11:28:38.348467 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 358/722] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:38 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:39.369359 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:39.369992 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:39.376711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:39.377194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:39.377628 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:39.378386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:39.378871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:39.379315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:39.512886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:39.520585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dfd30f32-4b81-4da6-bdfd-40ee191029e9 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.155393 Aug 10 11:28:39.521154 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 365/723] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:39 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:40.542103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:40.542626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:40.549006 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:40.549482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:40.549916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:40.550592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:40.551041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:40.551489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:40.685325 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:40.692618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-69123a43-00cd-46cf-a3a3-48182b6b9cdb tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.154752 Aug 10 11:28:40.693189 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 359/724] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:40 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:28:41.714876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:41.715416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:41.721930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:41.722453 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:41.722874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:41.723582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:41.724057 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:41.724488 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:41.856905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:41.864395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7caeab60-a88a-4477-a739-87cc3141da29 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1319 microversion: 2.1 time: 0.153974 Aug 10 11:28:41.864984 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 366/725] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:41 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:42.884652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:28:42.885334 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:42.887649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:28:42.892366 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:42.892843 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:42.893273 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:42.893952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:42.894397 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:42.894815 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:43.028440 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:28:43.035811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1e513d50-34c4-497f-9ac3-a37a3abc2aaf tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1507 microversion: 2.1 time: 0.155001 Aug 10 11:28:43.036411 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 360/726] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:28:42 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:28:43.056821 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "855d8f22-8072-4f0e-83be-bee26eb1d383", "device": "/dev/sdb"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:28:43.059244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:28:43.065917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:43.066395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:43.066825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:43.067499 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:28:43.067942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:28:43.068417 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:28:43.906509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-497281aa-2f8f-4902-a8e1-b3c341156e80 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "POST /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853538 Aug 10 11:28:43.907144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 367/727] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:28:43 2022] POST /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:29:03.960441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:03.963212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:03.965253 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:03.965913 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=31 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:03.970612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:03.971094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:03.971538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:03.972257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:03.972744 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:03.973172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:04.163761 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=11 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:04.164562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:04.260068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-feefae9e-950a-4538-b416-08ee12345ff8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "POST /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/action" status: 202 len: 0 microversion: 2.1 time: 0.302681 Aug 10 11:29:04.261830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 361/728] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:29:03 2022] POST /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:29:04.275853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4452f58f-78a9-4af2-9281-b61ea37bb22d"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:04.277853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:04.284176 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:04.284667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:04.285105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:04.285809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:04.286263 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:04.286694 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:04.372841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:04.373422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:04.379595 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:04.380115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:04.380612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:04.381252 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:04.381686 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:04.382124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:04.466775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lazy-loading 'services' on Instance uuid b6aeb94b-88c4-4f5c-844a-5fff3d2848dc {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:29:04.752164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4040aa66-eb94-4701-a96d-07ff24063bac tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/os-volume_attachments/f3cd2996-d64e-4b30-8dca-179d3ec404c1" status: 202 len: 0 microversion: 2.1 time: 0.489025 Aug 10 11:29:04.758117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 362/729] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:29:04 2022] DELETE /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/os-volume_attachments/f3cd2996-d64e-4b30-8dca-179d3ec404c1 => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:29:04.758117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:04.758410 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:04.765659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:04.766200 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:04.766634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:04.767338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:04.767796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:04.768249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:04.925112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:04.937499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f8591fc7-9126-4f5e-b48a-7aa2b4f93dc9 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1752 microversion: 2.1 time: 0.181145 Aug 10 11:29:04.937499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 363/730] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:04 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1752 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:05.218593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cd99f90c-c856-4673-b929-b05d52e6029f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056126 Aug 10 11:29:05.219220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 368/731] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:29:04 2022] POST /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:29:05.958477 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:05.959861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:05.969656 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:05.970428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:05.970954 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:05.971752 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:05.972337 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:05.972764 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:06.121250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:06.129250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7c269083-3fbb-4d9e-b737-a2c28038651b tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.175401 Aug 10 11:29:06.130469 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 364/732] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:05 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:06.953943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-56f3e8b8-375f-44cc-90a6-bf60b650f9bc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:06.960320 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56f3e8b8-375f-44cc-90a6-bf60b650f9bc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:06.960798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56f3e8b8-375f-44cc-90a6-bf60b650f9bc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:06.961226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-56f3e8b8-375f-44cc-90a6-bf60b650f9bc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:07.023388 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-56f3e8b8-375f-44cc-90a6-bf60b650f9bc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Going to try to stop instance {{(pid=118425) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 11:29:07.154043 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:07.154721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:07.161476 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:07.161960 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:07.162392 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:07.163334 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:07.163943 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:07.164545 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:07.246448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-56f3e8b8-375f-44cc-90a6-bf60b650f9bc tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/action" status: 202 len: 0 microversion: 2.1 time: 0.296896 Aug 10 11:29:07.247158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 369/733] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:29:06 2022] POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:29:07.255718 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:07.260552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:07.263967 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:07.264503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:07.264937 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:07.265691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:07.266141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:07.266568 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:07.344384 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:07.352744 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e73bbe7b-8275-4728-ad42-0cecb32d6a18 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.203584 Aug 10 11:29:07.366666 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 365/734] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:07 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:07.415734 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:07.423101 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b09f0404-3436-4ded-badd-20efbb0f8c2d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.171419 Aug 10 11:29:07.423672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 370/735] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:07 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:08.375019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:08.375626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:08.382040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:08.389102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:08.389102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:08.389102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:08.389102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:08.389746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:08.445020 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:08.446024 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:08.454423 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:08.455022 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:08.455858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:08.456798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:08.457350 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:08.457870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:08.579552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:08.588438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a95ccb33-6bb1-46b3-ab34-0890895568dd tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.217139 Aug 10 11:29:08.589124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 366/736] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:08 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:08.615776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:08.624159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dd59eaa9-7549-425f-b25f-a50bab090ac8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.183296 Aug 10 11:29:08.624719 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 371/737] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:08 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:09.392531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:09.393334 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:09.400952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:09.401434 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:09.401864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:09.402546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:09.402996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:09.403414 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:09.485318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lazy-loading 'services' on Instance uuid fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:29:09.609298 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:09.609906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:09.616245 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:09.616728 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:09.617164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:09.617848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:09.618466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:09.618719 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:09.766189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:09.774076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-93e183b7-5920-4c3a-a468-42643d7bf2c8 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.168631 Aug 10 11:29:09.781474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 372/738] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:09 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:09.781474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:09.781474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:09.785477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:09.785955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:09.786381 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:09.787056 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:09.787502 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:09.787920 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:09.815670 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5df90687-1542-44c0-8c2c-59ab32a295c5 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c/os-volume_attachments/855d8f22-8072-4f0e-83be-bee26eb1d383" status: 202 len: 0 microversion: 2.1 time: 0.427152 Aug 10 11:29:09.816422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 367/739] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:29:09 2022] DELETE /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c/os-volume_attachments/855d8f22-8072-4f0e-83be-bee26eb1d383 => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:29:09.928541 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:09.936699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-af294da2-8838-46b1-8846-4a437dccc3df tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.160660 Aug 10 11:29:09.937272 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 373/740] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:09 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:10.796552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:10.797160 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:10.803283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:10.803753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:10.804211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:10.804884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:10.805331 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:10.805770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:10.949995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:10.958373 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:10.958894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fca98b97-0feb-4c99-8ca9-17e8370a84b5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.166905 Aug 10 11:29:10.958996 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:10.959313 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 368/741] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:10 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:10.965966 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:10.966451 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:10.966886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:10.967579 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:10.968097 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:10.968521 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:11.099141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:11.107004 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f51f80bd-885e-48bc-b3c0-899f33470676 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.152617 Aug 10 11:29:11.107569 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 374/742] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:10 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:11.982406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:11.982406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:11.987990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:11.988489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:11.988921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:11.989609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:11.990133 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:11.990567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:12.126764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:12.127370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:12.133325 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:12.133876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:12.134524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:12.135059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:12.136425 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:12.136885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:12.137311 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:12.141330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-07f9a480-548a-4840-bf57-b6655115010d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.164567 Aug 10 11:29:12.141901 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 369/743] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:11 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:12.272350 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:12.281433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8c404dee-8085-479e-8896-936238bbdf56 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.158478 Aug 10 11:29:12.282002 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 375/744] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:12 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:13.162522 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:13.163131 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:13.170174 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:13.170652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:13.171095 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:13.171776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:13.172250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:13.172671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:13.302969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:13.303480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:13.310980 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:13.311462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:13.311890 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:13.312606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:13.313053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:13.313346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:13.313474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:13.321260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c7169cc1-f6c7-4809-88f2-f523a029eeab tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.162591 Aug 10 11:29:13.321968 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 370/745] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:13 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:13.443977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:13.451442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c4cbdba9-0f9b-4807-a9f0-4d1cc562dea9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.152312 Aug 10 11:29:13.452019 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 376/746] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:13 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:14.343590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:14.344224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:14.350660 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:14.351160 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:14.351586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:14.352310 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:14.353251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:14.353692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:14.472923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:14.473530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:14.479980 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:14.480541 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:14.480963 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:14.481648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:14.482097 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:14.482518 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:14.499081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:14.506935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-cbc93540-8a7a-4e61-b2f0-5eabe27a2d81 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.168238 Aug 10 11:29:14.507502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 371/747] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:14 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:14.611641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:14.620451 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5ca062c3-e1fe-42c0-9c04-539ff708fbc1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.151332 Aug 10 11:29:14.621063 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 377/748] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:14 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:15.528811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:15.529412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:15.536851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:15.537341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:15.537778 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:15.538470 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:15.538922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:15.539341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:15.641171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:15.641745 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:15.648178 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:15.648667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:15.649102 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:15.650399 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:15.650916 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:15.651350 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:15.688776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:15.697673 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-12e1ee36-4d59-4607-bfa3-8784e88a4cb0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.173481 Aug 10 11:29:15.698367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 372/749] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:15 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:15.788448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:15.796110 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6facd5f0-1f5d-420d-8a65-fe35a90d7674 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.158815 Aug 10 11:29:15.796673 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 378/750] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:15 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:15.922527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:15.924831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:15.931465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:15.931939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:15.932391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:15.933074 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:15.933563 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:15.933965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:15.957571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lazy-loading 'flavor' on Instance uuid 7f999fcc-0926-4db9-9acc-218a002e1ae4 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:29:16.115730 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:16.312723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4dbc5265-bea0-4ab6-8273-0be8dbfc7b9e tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/action" status: 200 len: 32 microversion: 2.1 time: 0.394044 Aug 10 11:29:16.313405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 373/751] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:29:15 2022] POST /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/action => generated 32 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:29:16.323386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:16.323989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:16.329926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:16.330412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:16.331092 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:16.331781 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:16.332404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:16.332825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:16.469990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:16.478706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-70a02831-55fe-4ce2-8d7f-9e5f3e6ebbf7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.158769 Aug 10 11:29:16.479281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 379/752] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:16 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:16.720739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:16.721421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:16.728360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:16.729101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:16.729544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:16.730244 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:16.730699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:16.731126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:16.817696 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:16.818358 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:16.825374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:16.825896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:16.826327 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:16.827228 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:16.827713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:16.828330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:16.912389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:16.921055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-51c4766f-3231-4cb6-8f56-086f5cf552fe tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.205490 Aug 10 11:29:16.921869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 374/753] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:16 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:16.982132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:16.989607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e96dd8fc-c89d-4066-b6fa-c34c9c82ab03 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.175727 Aug 10 11:29:16.990174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 380/754] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:16 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:17.288002 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:17.288525 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:17.294707 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.295192 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.295628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.296339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.296793 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.297226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.322276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:29:17.500319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:17.500850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:17.506856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.507555 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.507788 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.508465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.509521 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.510077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.633624 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-70c897d7-1cce-4629-8166-eda5eeddec0d tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 204 len: 0 microversion: 2.1 time: 0.349192 Aug 10 11:29:17.634396 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 375/755] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:29:17 2022] DELETE /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:29:17.644322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:17.644468 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:17.644468 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:17.649843 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.650337 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.650774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.651465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f0777153-8379-4901-a7a5-515bee78b959 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.155050 Aug 10 11:29:17.651573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.651913 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.652037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 381/756] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:17 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:17.664071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.783078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:17.791104 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-13ca68ae-4de4-4674-98b7-2c2b8f3634dc tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1513 microversion: 2.1 time: 0.152115 Aug 10 11:29:17.791698 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 376/757] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:17 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:17.941920 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:17.942521 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:17.949692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.950173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.950636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.951310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:17.951758 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:17.952227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:17.956468 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:18.011560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:18.012188 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:18.018005 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:18.018486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:18.018919 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:18.019594 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:18.020060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:18.020479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:18.154893 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:18.163083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9c571da1-b7ba-4edb-9a11-b1d914e632fb tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.224938 Aug 10 11:29:18.163930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 382/758] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:17 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:18.184250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:18.191572 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-62a7d43d-683b-46bd-b4d1-63a18a9004eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.184373 Aug 10 11:29:18.192152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 377/759] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:18 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:18.673357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:18.673885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:18.679726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:18.680240 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:18.681413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:18.682099 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:18.682547 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:18.682965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:18.812868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:18.813540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:18.815844 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:18.819908 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:18.820431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:18.820866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:18.822191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:18.822719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:18.823169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:18.824744 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a28d4db9-0c8c-4644-9cf2-38d2459b5d99 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.155300 Aug 10 11:29:18.825307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 383/760] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:18 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:18.953263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:18.960976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f65ee4a6-ec73-4abf-9124-844c917f793e tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1513 microversion: 2.1 time: 0.151898 Aug 10 11:29:18.961536 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 378/761] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:18 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:19.184440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:19.185044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:19.191202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.191680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.192147 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.192823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.193270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.193686 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.214374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:19.214956 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:19.220767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.221250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.221684 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.222362 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.222813 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.223235 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.416049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:19.422477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:19.423737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-725f01c4-ddf0-4b00-92f9-7b8430446857 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.213830 Aug 10 11:29:19.424611 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 379/762] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:19 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:19.430679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-35bb956b-6c9c-4df1-a396-9c236abe6bc0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.250219 Aug 10 11:29:19.431902 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 384/763] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:19 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:19.846631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:19.847240 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:19.854299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.854778 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.855212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.855905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.856406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.856831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.984631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:19.985701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:19.990381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:19.994013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.994867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.995628 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.996364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:19.996812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:19.997234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:19.998571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d263b6f7-aee1-4b38-a422-f1ace9962af1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.155821 Aug 10 11:29:19.999148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 380/764] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:19 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:20.142789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:20.152227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cb453df4-289f-47e7-9665-0f5185cecc15 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1513 microversion: 2.1 time: 0.172282 Aug 10 11:29:20.152593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 385/765] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:19 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:20.445815 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:20.447717 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:20.454035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:20.454227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:20.454652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:20.454763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:20.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:20.456049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:20.456503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:20.456974 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:20.461391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:20.461939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:20.462525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:20.463231 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:20.463682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:20.464342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:20.666124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:20.674628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b1df4cc7-8610-4f56-b563-96722e69476b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.232828 Aug 10 11:29:20.675451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 381/766] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:20 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:20.692933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:20.702771 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-210ec841-8a5c-44a8-ad61-317c29f69948 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.253142 Aug 10 11:29:20.703348 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 386/767] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:20 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:20.907003 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-26e5b9f6-f818-4b1b-8985-0edf5df9b310 req-b68cc5e5-de7f-4714-a842-84f270e00c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c", "name": "network-vif-deleted", "tag": "65ff0911-3286-4aa6-a533-6cf95b4e0c9d"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:20.919305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-26e5b9f6-f818-4b1b-8985-0edf5df9b310 req-b68cc5e5-de7f-4714-a842-84f270e00c37 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:20.919791 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-26e5b9f6-f818-4b1b-8985-0edf5df9b310 req-b68cc5e5-de7f-4714-a842-84f270e00c37 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:20.920247 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-26e5b9f6-f818-4b1b-8985-0edf5df9b310 req-b68cc5e5-de7f-4714-a842-84f270e00c37 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:20.932592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-26e5b9f6-f818-4b1b-8985-0edf5df9b310 req-b68cc5e5-de7f-4714-a842-84f270e00c37 service nova] Creating event network-vif-deleted:65ff0911-3286-4aa6-a533-6cf95b4e0c9d for instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c on hv-cinder-85061 Aug 10 11:29:20.937439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-26e5b9f6-f818-4b1b-8985-0edf5df9b310 req-b68cc5e5-de7f-4714-a842-84f270e00c37 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095410 Aug 10 11:29:20.938016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 382/768] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:29:21.020992 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:21.021606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:21.028128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.031393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.031393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.031393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.031393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.031766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.161780 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:21.170697 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2f63f561-abec-4ffe-97bf-7b21d6cc2fa3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.153579 Aug 10 11:29:21.171274 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 387/769] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:21 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:21.173460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:21.174133 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:21.180341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.185856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.185856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.185856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.185856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.186359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.250089 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:21.257815 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-65a950d9-0628-490a-960f-91cb736ece58 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1304 microversion: 2.1 time: 0.088710 Aug 10 11:29:21.258436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 383/770] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:21 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:21.702095 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:21.702702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:21.709353 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.709838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.710274 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.710960 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.711412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.711839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.724832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:21.727023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:21.731503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.731984 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.732444 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.733130 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:21.733585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:21.734038 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:21.909198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:21.917489 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b8c8e1d4-9636-46fc-96e3-d353b8228997 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.219166 Aug 10 11:29:21.918082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 388/771] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:21 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:21.929359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:21.937610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ad6a1e34-ac7c-45c3-85d2-e27afdf20d3d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1757 microversion: 2.1 time: 0.216763 Aug 10 11:29:21.938174 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 384/772] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:21 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:22.191939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:22.192572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:22.199396 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.199881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.200342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.201031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.201485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.201907 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.280270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:22.280860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:22.290497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.290497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.290497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.290497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.290948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.290948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.323113 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.323596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.324069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.324519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lazy-loading 'fault' on Instance uuid fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:29:22.342873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:22.350864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-366d12e1-8f19-44e0-a158-a98d04e0e790 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.162704 Aug 10 11:29:22.351424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 389/773] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:22 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:22.368372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '687fc77f37c54cd5a4503723ae59a082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049e0892819c4a07b79c39737548839d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:22.375820 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-23bdb6ce-5308-45bd-99f4-c7ccbcc72b06 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 200 len: 1309 microversion: 2.1 time: 0.099590 Aug 10 11:29:22.376406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 385/774] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:22 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:22.937989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:22.938595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:22.945087 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.945570 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.945999 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.946786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.947234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.947665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.958790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:22.959513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:22.966099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.966583 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.967017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:22.967701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:22.968179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:22.968610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:23.153201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:23.161691 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2f9e1245-5431-4a8f-8f0f-dda132aea55b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1677 microversion: 2.1 time: 0.227522 Aug 10 11:29:23.162273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 390/775] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:22 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:23.168852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:23.177110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5f0baf1e-f1ca-4408-9a22-4442f75baade tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1760 microversion: 2.1 time: 0.222372 Aug 10 11:29:23.177696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 386/776] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:22 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1760 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:23.372292 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:23.372929 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:23.378865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:23.379384 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:23.381882 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:23.381882 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:23.381882 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:23.381882 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:23.398674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:23.399286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] [instance: fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:23.406039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:23.406519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:23.406953 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:23.407660 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:23.408141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:23.408562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:23.423851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] HTTP exception thrown: Instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c could not be found. Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Request method failure captured: Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c HTTP/1.1 Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85WVtwEQa9abG8wQV4fcPE9VPxVzFuKCKhwD13tjSGqE-9ruXsNyUYBIvpfTrT_5x1JE-5ZrKB7HUSTnIE0MD_vY79KV_T4FmERv47PyooHy61wD7a9jwN6LSdUmCwPUDsBgm3TczG8UTuwYBJRC1v9bKrODfFwFe3jeYPU53Mq5Nck Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 049e0892819c4a07b79c39737548839d Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1788879536 Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:29:23.425529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/049e0892819c4a07b79c39737548839d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/049e0892819c4a07b79c39737548839d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/049e0892819c4a07b79c39737548839d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_049e0892819c4a07b79c39737548839d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesSnapshotTestJSON-1788879536 Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 049e0892819c4a07b79c39737548839d Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1788879536 Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesSnapshotTestJSON-1788879536-project Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 687fc77f37c54cd5a4503723ae59a082 Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesSnapshotTestJSON-1788879536-project Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c could not be found. Aug 10 11:29:23.427152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c'} Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c could not be found. Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:29:23.427970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c could not be found. Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c could not be found. Aug 10 11:29:23.429589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:29:23.430946 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] Returning 404 to user: Instance fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:29:23.430946 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a6bd17d4-12d9-4dbd-b97c-ad470a467c52 tempest-VolumesSnapshotTestJSON-1788879536 tempest-VolumesSnapshotTestJSON-1788879536-project] 10.222.0.13 "GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c" status: 404 len: 111 microversion: 2.1 time: 0.032206 Aug 10 11:29:23.430946 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 387/777] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:23 2022] GET /compute/v2.1/servers/fc8b9a6e-a162-4a7a-9fa1-bda56ce41b8c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:29:23.513201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:23.521134 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-693297de-855e-4ce3-9f16-836935588777 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.152984 Aug 10 11:29:23.521708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 391/778] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:23 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:24.183983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:24.184620 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:24.191103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.191580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.192031 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.192712 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.193161 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.193582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.329325 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:24.337280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2981f436-25d8-4300-9808-4cc2bc5e4017 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1654 microversion: 2.1 time: 0.157485 Aug 10 11:29:24.337852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 388/779] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:24 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:24.358083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6079a3bd-d80b-4ab8-904a-e542634c42d9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:24.364574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6079a3bd-d80b-4ab8-904a-e542634c42d9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.365056 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6079a3bd-d80b-4ab8-904a-e542634c42d9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.365479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6079a3bd-d80b-4ab8-904a-e542634c42d9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.390452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6079a3bd-d80b-4ab8-904a-e542634c42d9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Going to try to start instance {{(pid=118425) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 11:29:24.543635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:24.544775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:24.550297 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.550774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.551204 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.551875 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.552349 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.552767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.557792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:24.602548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6079a3bd-d80b-4ab8-904a-e542634c42d9 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/action" status: 202 len: 0 microversion: 2.1 time: 0.248013 Aug 10 11:29:24.603342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 392/780] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:29:24 2022] POST /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:29:24.611819 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:24.612564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:24.618860 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.619348 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.619777 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.620520 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:24.620978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:24.621402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:24.729496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:24.737822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-96b26080-b970-4811-8506-69a76349ae3c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.199073 Aug 10 11:29:24.738397 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 389/781] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:24 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:24.780051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:24.787530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6f0b57b3-3329-4748-9718-a096a136a41b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1663 microversion: 2.1 time: 0.179789 Aug 10 11:29:24.788141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 393/782] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:24 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:25.760670 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:25.761208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:25.768271 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:25.768753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:25.769208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:25.769866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:25.770313 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:25.770734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:25.809293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:25.809899 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:25.816592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:25.817076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:25.817508 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:25.818196 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:25.818644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:25.819063 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:25.955962 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:25.964815 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a1b2c6fe-a50d-4265-9e55-15e44938c112 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.208255 Aug 10 11:29:25.965388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 390/783] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:25 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:25.985580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:25.992868 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3d2e4f0b-98f5-4288-b081-7b1a9d72c7e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1663 microversion: 2.1 time: 0.188059 Aug 10 11:29:25.993930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 394/784] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:25 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1663 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:26.986340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:26.987005 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:26.993918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:26.994396 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:26.994826 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:26.995539 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:26.995985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:26.996430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:27.014450 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:27.015060 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:27.021531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:27.022034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:27.022472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:27.023171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:27.023620 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:27.024098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:27.194548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:27.202069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:27.210386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-16812534-f648-4431-b9cc-4dc54faf430c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1667 microversion: 2.1 time: 0.199557 Aug 10 11:29:27.211002 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 395/785] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:27 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1667 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:27.217570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-97ae156b-0774-4fbe-8dcf-9b407d447b93 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.235030 Aug 10 11:29:27.218164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 391/786] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:26 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:28.239569 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:28.240209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:28.247769 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:28.248220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:28.248653 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:28.249329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:28.249779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:28.250197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:28.383872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:28.392022 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5d6fffd7-eeea-41ff-95e0-c85ce428be10 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.156216 Aug 10 11:29:28.392598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 396/787] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:28 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:29.413559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:29.414163 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:29.421173 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:29.425258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:29.425258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:29.425258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:29.425258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:29.425687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:29.552042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:29.560491 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-35c52a70-253b-43a3-aae0-fb056c80b3fa tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.150892 Aug 10 11:29:29.561059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 392/788] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:29 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:30.582652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:30.583260 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:30.589905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:30.590389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:30.590825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:30.591512 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:30.591964 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:30.592416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:30.725515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:30.730407 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:30.735977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d63f1440-2326-458e-881a-712a41f8560b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.157332 Aug 10 11:29:30.737430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 397/789] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:30 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:31.758566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:31.760200 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:31.766389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:31.766870 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:31.767300 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:31.767987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:31.768463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:31.768888 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:31.907497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:31.915707 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-712f4810-923c-4369-87cf-c837d47a8f3f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.161099 Aug 10 11:29:31.916305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 393/790] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:31 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:32.939989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:32.940623 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:32.947980 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:32.948490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:32.948923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:32.949616 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:32.950063 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:32.950483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:33.080298 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:33.089454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ef282629-69bd-4f9e-aca8-09b5af1c2e2a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.153676 Aug 10 11:29:33.090364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 398/791] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:32 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:34.110700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:34.111362 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:34.113723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:34.119178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:34.122001 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:34.122001 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:34.122001 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:34.122001 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:34.122416 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:34.253535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:34.261471 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a7de121f-79f5-4cc4-8e9a-bbe936971f90 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.154735 Aug 10 11:29:34.262026 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 394/792] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:34 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:35.300265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:35.300265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:35.300265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=63 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:35.300265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:35.301598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:35.301598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:35.301598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:35.301598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:35.301954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:35.429863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:35.438437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2d98e515-81e4-4ce4-aa1b-d5b89829c2e2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.159560 Aug 10 11:29:35.439013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 399/793] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:35 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:36.460379 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:36.460902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:36.468955 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:36.469470 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:36.469911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:36.470608 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:36.471124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:36.471548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:36.613735 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:36.622092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-86cb5054-74a3-4057-91bb-3354be30307c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.165716 Aug 10 11:29:36.622669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 395/794] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:36 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:37.644136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:37.644674 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:37.651259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:37.651742 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:37.652210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:37.652903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:37.653353 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:37.653776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:37.804705 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:37.813353 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ecb94256-fa7e-4c74-9d18-e05a85b9b186 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.173466 Aug 10 11:29:37.813913 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 400/795] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:37 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:38.835420 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:38.836045 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:38.843202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:38.843681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:38.844141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:38.844824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:38.845271 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:38.845723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:38.972493 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:38.980386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a6f2428a-3e80-4cae-9694-d3c1bd279c36 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.149052 Aug 10 11:29:38.980951 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 396/796] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:38 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:39.666734 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:39.667263 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:39.673627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:39.674109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:39.674537 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:39.675216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:39.675666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:39.676119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:39.699701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lazy-loading 'flavor' on Instance uuid 97faf99c-8b42-41ba-8242-38a47df81e60 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:29:40.002128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:40.002691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:40.009925 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:40.010408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:40.010842 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:40.011540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:40.012021 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:40.012441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:40.037707 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fb56cf07-4e00-4409-8b90-c95ebe1440cf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "POST /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60/action" status: 202 len: 0 microversion: 2.1 time: 0.375426 Aug 10 11:29:40.042521 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 401/797] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:29:39 2022] POST /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:29:40.047739 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:40.048768 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:40.055075 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:40.055563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:40.056053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:40.056761 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:40.057236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:40.057704 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:40.225692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:40.234053 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-80706279-41d7-4210-92dc-81e214fbd51b tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.235911 Aug 10 11:29:40.234628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 397/798] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:39 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:40.245053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:40.252736 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-453e3c6b-ae9a-46b9-86fd-df040f76e375 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.208978 Aug 10 11:29:40.253236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 402/799] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:40 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:41.255640 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:41.256274 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:41.263728 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:41.264249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:41.264678 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:41.265354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:41.265798 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:41.266216 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:41.273948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:41.274800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:41.281238 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:41.281728 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:41.282184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:41.282874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:41.283331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:41.283789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:41.458007 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:41.466101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e7ad9238-65ba-4a6a-8e60-e441ae5617c1 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.214286 Aug 10 11:29:41.466678 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 398/800] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:41 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:41.470913 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:41.478422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6d745e75-9678-4010-aed5-ca0881cf35b3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.208304 Aug 10 11:29:41.478976 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 403/801] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:41 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:42.487510 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:42.488203 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:42.495531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:42.496045 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:42.496509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:42.497201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:42.497652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:42.498073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:42.499086 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:42.499701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:42.506163 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:42.506642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:42.507149 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:42.507863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:42.508335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:42.508755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:42.689850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:42.698277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e68fa917-2b47-40fc-9a53-fbe9ad913429 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.214612 Aug 10 11:29:42.698852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 399/802] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:42 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:42.703291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:42.711377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-123b932c-7865-451a-bf30-83ffb8ec31d8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.216252 Aug 10 11:29:42.712039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 404/803] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:42 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:43.719010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:43.719633 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:43.726019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:43.726490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:43.726917 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:43.727673 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:43.728664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:43.729102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:43.732769 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:43.733476 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:43.739748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:43.740266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:43.741498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:43.741498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:43.741813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:43.742241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:43.934954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:43.937969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:43.942688 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4c2c02c8-49f8-4cee-afee-0a69fdb15970 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.213878 Aug 10 11:29:43.943255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 405/804] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:43 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:43.946128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3fccdeac-04b8-48d3-a9f9-fbb382ad1dfe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.230887 Aug 10 11:29:43.946985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 400/805] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:43 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:44.963201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:44.963725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:44.968811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:44.969520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:44.970316 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:44.970803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:44.971232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:44.971911 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:44.972388 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:44.972806 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:44.975544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:44.976252 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:44.976709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:44.977407 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:44.977863 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:44.978295 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:45.118534 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:45.127417 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-55d00e3b-7303-4fda-bbb9-15d21e5dbae1 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.168269 Aug 10 11:29:45.128016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 406/806] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:44 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:45.255165 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:45.263716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-099fe3cd-a6db-45f3-a7eb-201502a1990a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.298620 Aug 10 11:29:45.266453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 401/807] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:44 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:46.149283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:46.149927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:46.156455 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:46.156937 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:46.157366 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:46.158075 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:46.158558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:46.158971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:46.285219 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:46.285858 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:46.290961 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:46.292668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:46.293158 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:46.293607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:46.294287 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:46.294736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:46.295155 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:46.298958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7314ed4c-75c6-4a1e-8c83-1c289eca210f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.153555 Aug 10 11:29:46.299528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 407/808] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:46 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:46.435194 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:46.443577 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c1d95199-8351-4d18-90c8-a2fff6116166 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1737 microversion: 2.1 time: 0.162333 Aug 10 11:29:46.444177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 402/809] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:46 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:47.319525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:47.320149 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:47.326557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:47.327044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:47.327500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:47.328199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:47.328654 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:47.329076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:47.460901 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:47.466122 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:47.466899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:47.469531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-948a23a9-c746-41ad-b860-bc72be77bf2e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.153791 Aug 10 11:29:47.470279 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 408/810] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:47 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:47.475338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:47.476250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:47.477282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:47.478686 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:47.479303 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:47.479726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:47.614930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:47.623103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e6715ec5-6989-4590-9ffe-a93cf0622463 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1717 microversion: 2.1 time: 0.161671 Aug 10 11:29:47.623656 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 403/811] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:47 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:29:47.686377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:47.686870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:47.692776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:47.693263 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:47.693715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:47.694384 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:47.694836 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:47.695258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:47.821767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] HTTP exception thrown: Cannot 'detach_volume' instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 while it is in vm_state rescued Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Request method failure captured: Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: DELETE /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments/4452f58f-78a9-4af2-9281-b61ea37bb22d HTTP/1.1 Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHwu4FUR1_6OifWImd_SAoLvZrJFAvoiHwxJf-Mi0BuQaKZ6BnuSgu648_Z7D4SbmaZtsmt0NYxxeKVeDrQz34LCrsGWwa4sD3bm004i3qaMtU1umyDyLQRBIYUkSx4m7-GrNzpO-X4fjlKSktXQwvPigXNg1NLVD20w2HraTJPXI Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:29:47.823446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 9b5890ee9a114299b0a15a6608503632 Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:29:47.825155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Cannot 'detach_volume' instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 while it is in vm_state rescued Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'server_id': '7f999fcc-0926-4db9-9acc-218a002e1ae4', 'id': '4452f58f-78a9-4af2-9281-b61ea37bb22d'} Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:29:47.829133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 while it is in vm_state rescued Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 while it is in vm_state rescued Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:29:47.830632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Returning 409 to user: Cannot 'detach_volume' instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 while it is in vm_state rescued {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:29:47.832175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1f3320dd-54c8-47e2-a6fc-76818fa5cdbd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments/4452f58f-78a9-4af2-9281-b61ea37bb22d" status: 409 len: 152 microversion: 2.1 time: 0.142520 Aug 10 11:29:47.832175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 409/812] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:29:47 2022] DELETE /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments/4452f58f-78a9-4af2-9281-b61ea37bb22d => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 11:29:47.834088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:47.834604 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:47.841556 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:47.842031 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:47.842460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:47.843134 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:47.843582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:47.844019 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:48.015571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:48.157010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2590d955-e0a2-4a58-8289-c99c673c37fe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "POST /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/action" status: 202 len: 0 microversion: 2.1 time: 0.326858 Aug 10 11:29:48.158262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 404/813] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:29:47 2022] POST /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:29:48.166642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:48.167353 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:48.173968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:48.174482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:48.174908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:48.175590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:48.176057 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:48.176478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:48.305045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:48.312985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-14215078-ce0a-4660-b2fc-e38c0d728456 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1725 microversion: 2.1 time: 0.150321 Aug 10 11:29:48.313552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 410/814] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:48 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:48.491217 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:48.491953 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:48.499685 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:48.500199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:48.500634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:48.501326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:48.501774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:48.502193 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:48.643035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:48.650825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ff4639d8-ed6e-4a81-abe5-cbf14e706a3a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.163828 Aug 10 11:29:48.651387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 405/815] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:48 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:49.335361 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:49.336150 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:49.343053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:49.343535 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:49.343964 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:49.344665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:49.345217 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:49.345637 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:49.481042 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:49.488924 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-429cf833-22b8-4de6-afb2-33570d1206ae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1725 microversion: 2.1 time: 0.157715 Aug 10 11:29:49.489482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 411/816] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:49 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:49.671290 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:49.671832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:49.678378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:49.678918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:49.679380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:49.680101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:49.680625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:49.681076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:49.813145 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:49.820880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4052a127-5247-4e2c-bbfe-b3d0a53ccc8b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.153710 Aug 10 11:29:49.821451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 406/817] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:49 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:50.509995 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:50.510702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:50.517319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:50.519500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:50.519500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:50.519500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:50.519500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:50.520174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:50.547190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:29:50.668901 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:50.676971 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7b5e3ebf-f322-4afb-8097-55b63266badc tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1725 microversion: 2.1 time: 0.170828 Aug 10 11:29:50.677565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 412/818] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:50 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:50.842973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:50.843584 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:50.850017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:50.850503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:50.850944 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:50.851634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:50.852115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:50.852545 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:50.985528 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:50.992995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0076cb49-d6ac-46d6-ada6-a99e745671c4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.153878 Aug 10 11:29:50.993568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 407/819] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:50 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:51.699689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:51.700347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:51.707218 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:51.707700 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:51.708171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:51.708856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:51.709307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:51.709730 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:51.841648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:51.849464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9008229c-b7f8-4c41-8ecf-709a7d5d0d83 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1725 microversion: 2.1 time: 0.154900 Aug 10 11:29:51.850024 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 413/820] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:51 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:52.014317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:52.014942 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:52.020888 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:52.021361 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:52.021790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:52.022497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:52.022940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:52.023358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:52.377948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:52.385856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d128277a-86c4-4ad6-b9aa-9d26cab72ab2 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.375266 Aug 10 11:29:52.386369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 408/821] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:52 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:52.871909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:52.872465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:52.878830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:52.879312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:52.879747 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:52.880454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:52.880907 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:52.881329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:53.010022 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:53.018248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b9fc8a22-f466-418b-8662-853cc909454f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1725 microversion: 2.1 time: 0.150903 Aug 10 11:29:53.018802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 414/822] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:52 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:53.407023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:53.407653 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:53.413950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:53.414482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:53.414920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:53.416133 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:53.416760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:53.417002 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:53.550702 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:53.559105 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-63dc2457-da08-45f7-8d8c-c3aa2818f3f4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.155876 Aug 10 11:29:53.559696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 409/823] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:53 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:54.038588 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:54.039228 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:54.045565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:54.046049 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:54.046481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:54.047197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:54.047650 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:54.048105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:54.180487 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:54.189205 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-519c29a2-c77a-49cd-ac22-b8d068044029 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1731 microversion: 2.1 time: 0.154378 Aug 10 11:29:54.189773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 415/824] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:54 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:54.210918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:54.211452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:54.218075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:54.218564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:54.221557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:54.221557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:54.221557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:54.221557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:54.299306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-18bb8dc1-2d1f-48ee-9349-bf64ae798b48 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092564 Aug 10 11:29:54.299911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 410/825] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 10 11:29:54 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:29:54.580268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:54.580869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:54.588153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:54.588755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:54.589704 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:54.590493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:54.591059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:54.591607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:54.830057 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:54.838446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-90115ac4-f723-4d95-b2a9-efd99c6c49e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.262359 Aug 10 11:29:54.838975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 416/826] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:54 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:55.392739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-7eb2df81-d27e-4244-b8b1-9249f571166c req-8502fb87-c3b1-46c3-8201-6b74a8d8e9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f999fcc-0926-4db9-9acc-218a002e1ae4", "tag": "c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:55.403847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-7eb2df81-d27e-4244-b8b1-9249f571166c req-8502fb87-c3b1-46c3-8201-6b74a8d8e9c0 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:55.404364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-7eb2df81-d27e-4244-b8b1-9249f571166c req-8502fb87-c3b1-46c3-8201-6b74a8d8e9c0 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:55.404785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-7eb2df81-d27e-4244-b8b1-9249f571166c req-8502fb87-c3b1-46c3-8201-6b74a8d8e9c0 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:55.417821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-7eb2df81-d27e-4244-b8b1-9249f571166c req-8502fb87-c3b1-46c3-8201-6b74a8d8e9c0 service nova] Creating event network-changed:c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5 for instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 on hv-cinder-85061 Aug 10 11:29:55.423565 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-7eb2df81-d27e-4244-b8b1-9249f571166c req-8502fb87-c3b1-46c3-8201-6b74a8d8e9c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035061 Aug 10 11:29:55.424428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 411/827] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:29:55.859071 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:55.859723 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:55.866684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:55.867172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:55.867635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:55.868362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:55.869514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:55.870146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:56.013128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:56.035045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a9851fcd-4301-4c91-be65-65ae3325219f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.166152 Aug 10 11:29:56.035045 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 417/828] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:55 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:57.043980 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:57.044627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:57.050819 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:57.051286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:57.051761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:57.052487 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:57.052942 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:57.054268 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:57.189889 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:57.198209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-16a8f85f-6046-4098-9aa5-e344903d7493 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.159255 Aug 10 11:29:57.198795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 412/829] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:57 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:57.439750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-3a098558-7217-4b91-b335-faa97bc4937b req-0dcc1201-bab4-4bcb-b768-ebece3f75559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f999fcc-0926-4db9-9acc-218a002e1ae4", "tag": "c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:29:57.450731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3a098558-7217-4b91-b335-faa97bc4937b req-0dcc1201-bab4-4bcb-b768-ebece3f75559 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:57.451198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3a098558-7217-4b91-b335-faa97bc4937b req-0dcc1201-bab4-4bcb-b768-ebece3f75559 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:57.451622 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3a098558-7217-4b91-b335-faa97bc4937b req-0dcc1201-bab4-4bcb-b768-ebece3f75559 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:57.462309 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-3a098558-7217-4b91-b335-faa97bc4937b req-0dcc1201-bab4-4bcb-b768-ebece3f75559 service nova] Creating event network-changed:c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5 for instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 on hv-cinder-85061 Aug 10 11:29:57.467649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-3a098558-7217-4b91-b335-faa97bc4937b req-0dcc1201-bab4-4bcb-b768-ebece3f75559 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031503 Aug 10 11:29:57.468253 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 418/830] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:29:58.317333 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:58.317975 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:58.324652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:58.325136 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:58.325568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:58.326257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:58.326708 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:58.327129 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:58.463127 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:58.470759 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5b52d075-c53d-42be-9480-4ba8ecef67fc tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.255319 Aug 10 11:29:58.471639 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 413/831] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:58 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:29:59.493490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:29:59.494150 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:29:59.500270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:59.500757 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:59.501192 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:59.501880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:29:59.502333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:29:59.502755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:29:59.675119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:29:59.683511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-385d030c-2bff-4b12-9fb8-cb2794356019 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.194846 Aug 10 11:29:59.684096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 419/832] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:29:59 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:00.704942 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:00.706959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:00.715606 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:00.716213 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:00.716647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:00.717348 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:00.717805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:00.718234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:00.854997 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:00.863202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a9fcce21-2a24-4ad1-ac3f-8fdd04999b31 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.161837 Aug 10 11:30:00.863870 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 414/833] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:00 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:01.884075 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:01.885442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:01.892160 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:01.892644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:01.893077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:01.893764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:01.894219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:01.894646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:02.033099 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:02.040902 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3216a7f1-dbc9-4b93-941b-caa4d1f9f13d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.160568 Aug 10 11:30:02.045704 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 420/834] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:01 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:03.063020 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:03.063586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:03.070195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:03.070681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:03.071123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:03.072645 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:03.073103 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:03.073561 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:03.209940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:03.217806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-479df532-1884-403b-8f85-bdb69ac1e0bf tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.158875 Aug 10 11:30:03.219276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 415/835] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:03 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:04.239173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:04.239857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:04.247131 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:04.247618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:04.248075 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:04.248763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:04.249213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:04.249638 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:04.386671 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:04.394602 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a29f1f88-d4a9-476f-9891-ca907b88a2c0 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1569 microversion: 2.1 time: 0.159285 Aug 10 11:30:04.395267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 421/836] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:04 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:04.420242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:04.420857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:04.427196 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:04.427689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:04.428157 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:04.428841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:04.429291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:04.429716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:04.459839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118426) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:30:04.895231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6937e363-0895-4cfa-bb51-70b7ea73b876 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "POST /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60/action" status: 202 len: 0 microversion: 2.1 time: 0.478954 Aug 10 11:30:04.895891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 416/837] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:30:04 2022] POST /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:04.904456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:04.905061 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:04.911090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:04.911573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:04.912026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:04.912817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:04.913275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:04.913716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:05.049296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:05.059481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3f51419f-7755-497e-8dc7-3fb1a1b26745 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1517 microversion: 2.1 time: 0.159310 Aug 10 11:30:05.060251 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 422/838] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:04 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:05.086770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-4c5d6277-727c-4164-be2a-36bd53b2c0eb req-328ce697-12e0-466a-ae44-d783cb95f816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97faf99c-8b42-41ba-8242-38a47df81e60", "name": "network-vif-unplugged", "status": "completed", "tag": "8afd3334-557f-4bbd-97db-30863c2d80cc"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:05.099045 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-4c5d6277-727c-4164-be2a-36bd53b2c0eb req-328ce697-12e0-466a-ae44-d783cb95f816 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:05.099532 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-4c5d6277-727c-4164-be2a-36bd53b2c0eb req-328ce697-12e0-466a-ae44-d783cb95f816 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:05.099961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-4c5d6277-727c-4164-be2a-36bd53b2c0eb req-328ce697-12e0-466a-ae44-d783cb95f816 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:05.113457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.compute.server_external_events [req-4c5d6277-727c-4164-be2a-36bd53b2c0eb req-328ce697-12e0-466a-ae44-d783cb95f816 service nova] Unable to find a host for instance 97faf99c-8b42-41ba-8242-38a47df81e60. Dropping event network-vif-unplugged {{(pid=118426) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 11:30:05.114811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-4c5d6277-727c-4164-be2a-36bd53b2c0eb req-328ce697-12e0-466a-ae44-d783cb95f816 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031928 Aug 10 11:30:05.115047 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 417/839] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 11:30:05.190611 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:05.191173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:05.197722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:05.198448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:05.198995 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:05.199864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:05.200510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:05.201166 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:05.232993 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6b2cc797-bf4d-40ba-826d-abb7f6503119 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments/8bee97fd-11e5-48bc-8238-2b3b3ab56509" status: 200 len: 194 microversion: 2.20 time: 0.046338 Aug 10 11:30:05.234211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 423/840] 10.222.0.13 () {60 vars in 1454 bytes} [Wed Aug 10 11:30:05 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments/8bee97fd-11e5-48bc-8238-2b3b3ab56509 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:05.310512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:05.311049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:05.317178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:05.317654 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:05.318084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:05.318771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:05.319218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:05.319639 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:05.400175 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lazy-loading 'services' on Instance uuid fcf17719-c01d-4bcc-8a23-83d1a8a1a492 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:05.661364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-548699b5-a48e-4ded-a437-14d8a06f7e1d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments/8bee97fd-11e5-48bc-8238-2b3b3ab56509" status: 202 len: 0 microversion: 2.20 time: 0.355009 Aug 10 11:30:05.662007 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 418/841] 10.222.0.13 () {60 vars in 1457 bytes} [Wed Aug 10 11:30:05 2022] DELETE /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments/8bee97fd-11e5-48bc-8238-2b3b3ab56509 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:30:05.677380 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:05.679774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:05.683103 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=50 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:05.687923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:05.688435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:05.688865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:05.689547 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:05.689991 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:05.690408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:05.721276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a0299de4-6bf8-4bc3-97d7-bc982f39ebd3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047845 Aug 10 11:30:05.721765 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 424/842] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 10 11:30:05 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:06.080667 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:06.081367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:06.087788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.088319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.088745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.089425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.089876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.090304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.222990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:06.231236 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-21335279-a5ed-4890-bddb-1cb9786efb12 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1517 microversion: 2.1 time: 0.154913 Aug 10 11:30:06.231798 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 419/843] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:06 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:06.689700 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:06.690339 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:06.696398 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.697443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.697943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.698625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.699150 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.699567 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.722913 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0d906835-f5dd-4636-bb5b-d801d2f09afc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796/ips" status: 200 len: 149 microversion: 2.1 time: 0.200620 Aug 10 11:30:06.723582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 425/844] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:30:06 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796/ips => generated 149 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:06.734732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:06.735218 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:06.737009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:06.737202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:06.739404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:06.743048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.743533 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.743977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.744148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.744680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.744827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.745132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.745275 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.745557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.745841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.746449 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.747037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.778837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a1a128ca-bb56-45da-88b3-95fc6cbd035e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047971 Aug 10 11:30:06.782769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 420/845] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 10 11:30:06 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:06.823514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Invalid volume: volume bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b is already attached to instances: ab6e3975-83d1-4eed-944c-38567ce25a00 Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: POST /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796/os-volume_attachments HTTP/1.1 Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 74 Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:30:06.825239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {"volumeAttachment": {"volumeId": "bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b"}} Aug 10 11:30:06.830058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Invalid volume: volume bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b is already attached to instances: ab6e3975-83d1-4eed-944c-38567ce25a00 Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'server_id': 'baf2a390-b869-4d2f-9013-63011c65a796', 'body': {'volumeAttachment': {'volumeId': 'bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b'}}} Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b is already attached to instances: ab6e3975-83d1-4eed-944c-38567ce25a00 Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:06.830905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b is already attached to instances: ab6e3975-83d1-4eed-944c-38567ce25a00 Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:06.832647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:06.834082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:06.834082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:06.834082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:06.834082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b is already attached to instances: ab6e3975-83d1-4eed-944c-38567ce25a00 Aug 10 11:30:06.834082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:06.834082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 400 to user: Invalid volume: volume bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b is already attached to instances: ab6e3975-83d1-4eed-944c-38567ce25a00 {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:06.834082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e8f95de5-dc48-4dae-ab77-a2cb865ac76d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095773 Aug 10 11:30:06.834082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 426/846] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:30:06 2022] POST /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 11:30:06.836077 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:06.836580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:06.843729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.844234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.844671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.845354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:06.845807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:06.846227 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:06.864305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:06.873665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:30:07.252454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:07.253090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:07.260607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:07.261101 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:07.261537 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:07.262294 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:07.262750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:07.263198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:07.270607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-73837495-8555-4b5c-807d-d5203eb57554 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 204 len: 0 microversion: 2.1 time: 0.437996 Aug 10 11:30:07.271222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 421/847] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:30:06 2022] DELETE /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:30:07.279611 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:07.280426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:07.286323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:07.286814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:07.287254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:07.287947 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:07.288428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:07.288860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:07.454449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:07.464401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8694c8e2-d346-4ed5-a149-7509a87f6a46 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1517 microversion: 2.1 time: 0.215775 Aug 10 11:30:07.477320 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 427/848] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:07 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1517 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:07.488116 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:07.496979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b19a28ad-1c37-43bd-b454-254542c8cdc3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1681 microversion: 2.1 time: 0.221407 Aug 10 11:30:07.497656 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 422/849] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:07 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:07.793794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:07.795828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:07.808339 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:07.808806 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:07.809241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:07.809946 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:07.810398 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:07.815783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:07.841857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9b583c55-37b4-459b-8a5f-c201680c2324 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052696 Aug 10 11:30:07.842408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 428/850] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 10 11:30:07 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:08.486572 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:08.487177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:08.493671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:08.494372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:08.494807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:08.495486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:08.495933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:08.496501 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:08.527190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:08.527931 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:08.533977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:08.534462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:08.534970 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:08.535689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:08.536192 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:08.536625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:08.683327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:08.691408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-21b1a5ce-d19f-4705-9ba2-0efce14a7608 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1519 microversion: 2.1 time: 0.208616 Aug 10 11:30:08.692270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 423/851] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:08 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1519 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:08.705214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:08.713427 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a0d3955f-a608-44d4-82eb-89eac6115698 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1681 microversion: 2.1 time: 0.190662 Aug 10 11:30:08.713983 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 429/852] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:08 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:08.854344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:08.856604 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:08.862584 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:08.863069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:08.863511 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:08.864260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:08.864716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:08.865142 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:08.894519 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-392f2bb7-c7e7-44cf-aa89-c6789aa3d8f8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044355 Aug 10 11:30:08.895093 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 424/853] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 10 11:30:08 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:09.713568 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:09.714278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:09.721416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:09.721906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:09.722344 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:09.723036 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:09.723484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:09.723906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:09.729285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:09.734438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:09.735079 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:09.742117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:09.742248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:09.742625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:09.743320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:09.743766 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:09.744219 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:09.937492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:09.942218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:09.945144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-579235bf-3c55-4085-9e61-bb90e8187710 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1519 microversion: 2.1 time: 0.235452 Aug 10 11:30:09.945705 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 430/854] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:09 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:09.956914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0cd25d41-dfc8-45fb-9026-74c4692e1061 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1681 microversion: 2.1 time: 0.220320 Aug 10 11:30:09.956914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 425/855] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:09 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:09.957144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:09.957144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:09.960955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:09.961520 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:09.962028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:09.963553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:09.964103 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:09.964912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:09.998336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-704a310a-f93b-414a-87f8-114a4413b1b1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050119 Aug 10 11:30:09.998889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 431/856] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 10 11:30:09 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:10.967123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:10.967926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:10.972926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:10.973579 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:10.974746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:10.975230 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:10.975657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:10.976421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:10.976984 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:10.977404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:10.980606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:10.981087 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:10.981516 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:10.982199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:10.982645 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:10.983063 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:11.190824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:11.193461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:11.199816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0811f966-7582-4e04-8f39-03981b8993e5 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1519 microversion: 2.1 time: 0.236543 Aug 10 11:30:11.200515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 426/857] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:10 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:11.201764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9b428d3b-e76e-4507-8cc1-4136edb6d602 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1681 microversion: 2.1 time: 0.232781 Aug 10 11:30:11.202316 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 432/858] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:10 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:11.210974 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:11.213455 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:11.219356 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:11.219841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:11.220318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:11.221008 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:11.221457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:11.221880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:11.252150 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-005f3d28-a397-4167-89e3-6a02754ba9bc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045131 Aug 10 11:30:11.252711 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 427/859] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 10 11:30:11 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:12.222689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:12.223245 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:12.223607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:12.223755 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:12.230276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.230483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.230798 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.230939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.231354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.232161 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.232841 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.233478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.254683 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.255549 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.256062 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.256505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.453070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:12.460974 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-85142116-4b2b-46ab-85bb-32a3efd78deb tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1519 microversion: 2.1 time: 0.242291 Aug 10 11:30:12.461627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 433/860] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:12 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:12.464658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:12.466668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:12.469071 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:12.472671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-546b8d74-9892-461d-89d9-cf93f92bd130 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1681 microversion: 2.1 time: 0.253577 Aug 10 11:30:12.473234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 428/861] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:12 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:12.478213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.478213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.478213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.478213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.478686 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.478686 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.507088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e2650dd1-6906-4a05-813a-f1a3d7decebe tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044046 Aug 10 11:30:12.507710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 434/862] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 10 11:30:12 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:12.586144 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:12.586711 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:12.593785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.594276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.594707 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.595405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.595856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.596320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.622403 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:30:12.802173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-293cb548-8712-42b0-b47b-1c3620567e00 req-90733a89-b237-4b0f-ba7d-cafa4f862eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf2a390-b869-4d2f-9013-63011c65a796", "name": "network-vif-deleted", "tag": "0fa11193-0b09-4b89-88fe-421118ac0b2a"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:12.812314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-293cb548-8712-42b0-b47b-1c3620567e00 req-90733a89-b237-4b0f-ba7d-cafa4f862eeb service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:12.812832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-293cb548-8712-42b0-b47b-1c3620567e00 req-90733a89-b237-4b0f-ba7d-cafa4f862eeb service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:12.813270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-293cb548-8712-42b0-b47b-1c3620567e00 req-90733a89-b237-4b0f-ba7d-cafa4f862eeb service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:12.825236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-293cb548-8712-42b0-b47b-1c3620567e00 req-90733a89-b237-4b0f-ba7d-cafa4f862eeb service nova] Creating event network-vif-deleted:0fa11193-0b09-4b89-88fe-421118ac0b2a for instance baf2a390-b869-4d2f-9013-63011c65a796 on hv-cinder-85061 Aug 10 11:30:12.830236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-293cb548-8712-42b0-b47b-1c3620567e00 req-90733a89-b237-4b0f-ba7d-cafa4f862eeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033458 Aug 10 11:30:12.834275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 435/863] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:30:13.472108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-973fe6ec-fa69-42c7-b77e-738f8e6c5daa tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 204 len: 0 microversion: 2.20 time: 0.887532 Aug 10 11:30:13.475060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 429/864] 10.222.0.13 () {60 vars in 1280 bytes} [Wed Aug 10 11:30:12 2022] DELETE /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:30:13.492412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:13.494737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:13.495454 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:13.499233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:13.505388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:13.506495 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:13.507120 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:13.507302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:13.507891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:13.508584 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:13.509921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:13.510223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:13.511030 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:13.511549 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:13.514529 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:13.514958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:13.757474 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:13.762704 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:13.769947 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:13.770717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-402d248f-7c6e-4dfd-91ff-9656261c74b6 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1519 microversion: 2.1 time: 0.288618 Aug 10 11:30:13.771291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 436/865] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:13 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:13.771530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:13.772714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f8d93392-cee9-42b3-bfec-e63bf2081013 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.287146 Aug 10 11:30:13.773787 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 430/866] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:13 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:13.784359 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:13.784359 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:13.792112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:13.792744 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:13.793038 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:13.793740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:13.794189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:13.794760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:13.827888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:13.828545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:13.829041 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:13.829582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'fault' on Instance uuid baf2a390-b869-4d2f-9013-63011c65a796 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:13.886325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:13.886325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2ea279f1-e309-4c9b-9e31-df14993ee30d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1331 microversion: 2.1 time: 0.111736 Aug 10 11:30:13.887175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 437/867] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:13 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:14.793501 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:14.794068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:14.801495 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:14.802081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:14.802598 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:14.802711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:14.803230 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:14.803554 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:14.804231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:14.804665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:14.811144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:14.811326 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:14.811722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:14.812464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:14.812919 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:14.813345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:15.011230 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:15.014797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:15.019473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d7ca254d-e63c-4c8b-b7ea-34fa6af5b41a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1519 microversion: 2.1 time: 0.230751 Aug 10 11:30:15.020215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 431/868] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:14 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1519 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:15.025192 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:15.026812 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:15.028285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:15.029787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:15.031190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-13055f58-d52d-4bd0-94a7-7d66aae5a775 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.232572 Aug 10 11:30:15.031726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 438/869] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:14 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:15.034026 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:15.034566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:15.035055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:15.035832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:15.036401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:15.036911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:15.071039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:15.071619 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:15.072875 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:15.073550 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'fault' on Instance uuid baf2a390-b869-4d2f-9013-63011c65a796 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:15.120653 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:15.129327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-14abc7d5-7347-4d5e-ab7d-166e04130624 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 200 len: 1331 microversion: 2.1 time: 0.107693 Aug 10 11:30:15.129969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 432/870] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:15 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:16.041675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:16.042283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:16.048836 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:16.049318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:16.049757 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:16.050445 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:16.050899 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:16.051319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:16.054955 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:16.055562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:16.064260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:16.064999 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:16.065594 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:16.066857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:16.068652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:16.069452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:16.326256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:16.335616 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-194d2731-dcb1-4204-96e7-cbab6efc0e91 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.298445 Aug 10 11:30:16.336370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 439/871] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:16 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:16.341150 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:16.341886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:16.347832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:16.348467 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:16.349429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:16.350834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:16.350834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:16.351417 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:16.355688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:16.367962 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 HTTP/1.1 Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:30:16.370500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:30:16.371756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'baf2a390-b869-4d2f-9013-63011c65a796'} Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:16.373289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:30:16.374551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:16.376708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:16.377858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c17f8508-48a3-42e2-a3ec-85d29c0555ee tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 404 len: 111 microversion: 2.1 time: 0.040349 Aug 10 11:30:16.378584 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 440/872] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:16 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:30:16.382217 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:16.386195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:16.401922 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6fbe77fc-31fc-4b88-acc0-0ab7ab924917 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '.version_select at 0x7f6f4478f310>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:16.402312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f868fd1d-be3d-475e-8c13-0d7bce54b9af tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1722 microversion: 2.20 time: 0.338742 Aug 10 11:30:16.402312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 433/873] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:16 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:16.518590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6fbe77fc-31fc-4b88-acc0-0ab7ab924917 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-626006577" status: 202 len: 0 microversion: 2.1 time: 0.135097 Aug 10 11:30:16.519385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 441/874] 10.222.0.13 () {58 vars in 1218 bytes} [Wed Aug 10 11:30:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-626006577 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:16.936586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-dc4f6728-8089-40e2-80a4-4ff6cbed320e req-86a5b019-9222-4b70-8fd8-f7d82c87e389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf17719-c01d-4bcc-8a23-83d1a8a1a492", "name": "network-vif-deleted", "tag": "4e6451ea-a107-42b4-9e4e-d34766a2f2d9"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:16.949222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-dc4f6728-8089-40e2-80a4-4ff6cbed320e req-86a5b019-9222-4b70-8fd8-f7d82c87e389 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:16.949736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-dc4f6728-8089-40e2-80a4-4ff6cbed320e req-86a5b019-9222-4b70-8fd8-f7d82c87e389 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:16.950184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-dc4f6728-8089-40e2-80a4-4ff6cbed320e req-86a5b019-9222-4b70-8fd8-f7d82c87e389 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:16.964406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-dc4f6728-8089-40e2-80a4-4ff6cbed320e req-86a5b019-9222-4b70-8fd8-f7d82c87e389 service nova] Creating event network-vif-deleted:4e6451ea-a107-42b4-9e4e-d34766a2f2d9 for instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 on hv-cinder-85061 Aug 10 11:30:16.969732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-dc4f6728-8089-40e2-80a4-4ff6cbed320e req-86a5b019-9222-4b70-8fd8-f7d82c87e389 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038131 Aug 10 11:30:16.970661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 434/875] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:17.358572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:17.359324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:17.368030 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:17.368851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:17.371356 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:17.372270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:17.372925 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:17.373511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:17.424099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:17.424803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:17.432824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:17.433946 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:17.434551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:17.435331 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:17.435799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:17.436260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:17.441109 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:17.481438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:17.482314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:17.482817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:17.483277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lazy-loading 'fault' on Instance uuid fcf17719-c01d-4bcc-8a23-83d1a8a1a492 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:17.539975 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:17.549422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:17.555073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:17.559201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ebb7b82c-63c2-470b-bde1-18ea4997ad1e tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.204441 Aug 10 11:30:17.559874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:17.561086 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fe33c9c2-98af-4cd7-9498-dd93b712bd9b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1371 microversion: 2.20 time: 0.141721 Aug 10 11:30:17.563840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 435/876] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:17 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:17.573809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 442/877] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:17 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:17.937289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:17.937788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:17.944592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:17.945074 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:17.945499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:17.946184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:17.946625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:17.948413 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:18.029279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'services' on Instance uuid ab6e3975-83d1-4eed-944c-38567ce25a00 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:18.366508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-07a05aa4-4c6b-44d0-a7fa-d1e62d6a8d80 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments/bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b" status: 202 len: 0 microversion: 2.1 time: 0.432929 Aug 10 11:30:18.367098 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 436/878] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:30:17 2022] DELETE /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments/bef6b85d-1fa7-4aed-86bb-c9f60efbbd5b => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:30:18.375457 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:18.377710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:18.384437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:18.386347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:18.386347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:18.386549 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:18.386898 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:18.387364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:18.417438 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e274469a-6f29-4eb7-8969-1f884518333e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045975 Aug 10 11:30:18.417992 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 443/879] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:18 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:18.581596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:18.582571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:18.584579 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:18.585178 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:18.589436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:18.589929 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:18.590366 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:18.591121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:18.591578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:18.592026 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:18.592137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:18.592557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:18.592966 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:18.593640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:18.594082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:18.594501 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:18.627646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:18.628152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:18.628587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:18.629031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lazy-loading 'fault' on Instance uuid fcf17719-c01d-4bcc-8a23-83d1a8a1a492 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:18.688171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:18.696217 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:18.698262 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:18.699415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5271e47d-c3cd-49de-8af1-819d8afad332 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 200 len: 1371 microversion: 2.20 time: 0.118933 Aug 10 11:30:18.699976 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 444/880] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:18 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:30:18.754857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:18.762933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2f180648-a6d8-4672-8c69-763113b04eaa tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.186239 Aug 10 11:30:18.763521 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 437/881] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:18 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:19.429273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:19.431958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:19.438318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:19.438781 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:19.439245 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:19.439896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:19.440396 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:19.440832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:19.470588 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3d39583a-1414-40e2-b333-827a9082ffda tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Aug 10 11:30:19.471142 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 445/882] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:19 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:19.722885 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:19.723648 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:19.730914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:19.731399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:19.731831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:19.732545 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:19.732995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:19.733444 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:19.747377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] HTTP exception thrown: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Request method failure captured: Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 HTTP/1.1 Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UDQ0H5gNfLsj5ABantfOzbl9Zd9z5gzzsAeVkjhKYIzuOM5OtUc-8EfSh6g5xsx8BdIeMCXG5-hv6qaJfHNzHhxvJy1sgpbMb3pfHv0FRbsbzyztolGlMHOFWjtT0sy2oFak41E-Pwb9WMGWRKiTIfV8_jxyhq8Y_lWqP34CVLArU Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:30:19.749178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 87adb637dd814cf8be9ff6c2a2bc26ea Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:30:19.750855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'fcf17719-c01d-4bcc-8a23-83d1a8a1a492'} Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:19.751756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:30:19.753205 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:19.754641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Returning 404 to user: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:19.754641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b53ca317-9f38-4e60-a7a4-41ca196486a0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 404 len: 111 microversion: 2.20 time: 0.031643 Aug 10 11:30:19.754641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 438/883] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:19 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:30:19.759631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-28708661-4a47-42c9-aaf9-6cf2bb31600d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '.version_select at 0x7f6f4465a5e0>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:19.784139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:19.784789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:19.791533 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:19.791906 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:19.792373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:19.793065 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:19.793790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:19.794042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:19.871251 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-28708661-4a47-42c9-aaf9-6cf2bb31600d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272878655" status: 204 len: 0 microversion: 2.20 time: 0.115479 Aug 10 11:30:19.871834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 446/884] 10.222.0.13 () {60 vars in 1262 bytes} [Wed Aug 10 11:30:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272878655 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:30:19.957593 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:19.965888 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-88f36f76-8fb7-4a7e-a063-18bb2394887b tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.185485 Aug 10 11:30:19.966469 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 439/885] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:19 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:20.483435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:20.485620 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:20.492345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:20.492860 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:20.493303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:20.494034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:20.494496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:20.494933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:20.524894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-eea305fe-e990-418f-a296-4695284c6125 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045863 Aug 10 11:30:20.526076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 447/886] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:20 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:30:20.591174 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:20.591974 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:20.597856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:20.598331 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:20.598762 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:20.599441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:20.599889 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:20.600334 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:20.624528 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:30:20.791789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-33d041be-ff07-44d1-9019-d12413736509 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'create', calling method: .version_select at 0x7f6f4465a9d0>, body: {"keypair": {"name": "tempest-keypair-1484906262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5u7HGW00da1DiYbl5FHct2hH8M4D4ly3ud/B+E/HKZ3tcjkxXLRluqEarYTPNtkDHCON+RK6yUjuMxy/p5asr7S77WaWmbcqDQRAszirYp4rsM+MXag5QfJBy//+dVew=="}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:20.807129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-33d041be-ff07-44d1-9019-d12413736509 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Getting quotas for project 282c9e4b65d64085a0ba1a3d356f59fa. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:30:20.810891 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-33d041be-ff07-44d1-9019-d12413736509 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Getting quotas for user 87adb637dd814cf8be9ff6c2a2bc26ea and project 282c9e4b65d64085a0ba1a3d356f59fa. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:30:20.925934 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-33d041be-ff07-44d1-9019-d12413736509 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.138576 Aug 10 11:30:20.926568 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 448/887] 10.222.0.13 () {62 vars in 1200 bytes} [Wed Aug 10 11:30:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 11:30:20.986873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:20.987517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:20.993739 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:20.994220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:20.994646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:20.995319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:20.995767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:20.996225 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:21.001527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f55294f4-bb31-4f5a-bfe5-7b8c3394eb79 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 204 len: 0 microversion: 2.1 time: 0.413997 Aug 10 11:30:21.002114 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 440/888] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:30:20 2022] DELETE /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:30:21.011479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:21.014138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:21.018171 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:21.018665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:21.019128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:21.019827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:21.020330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:21.020755 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:21.211567 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:21.217056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:21.221065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f7e6e79c-f14d-4711-84b0-12cb9dd09af3 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.238098 Aug 10 11:30:21.221808 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 449/889] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:20 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:21.224989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-673ef6d2-9a13-420d-be00-473de2ca6cb4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1682 microversion: 2.1 time: 0.218525 Aug 10 11:30:21.225644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 441/890] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:21 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:22.245982 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:22.246598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:22.249697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:22.250832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:22.257981 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:22.258546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:22.259302 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:22.260774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:22.261327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:22.262439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:22.264684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:22.265391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:22.265987 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:22.266869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:22.267325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:22.268063 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:22.290271 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:22.587428 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:22.596727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9ae7148e-9a91-4f28-b94a-1e8b8b5c8198 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.354498 Aug 10 11:30:22.597510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 450/891] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:22 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:22.600669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:22.613396 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ded32141-ac0d-4f29-8265-7ce6d9def26d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1682 microversion: 2.1 time: 0.369652 Aug 10 11:30:22.614314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 442/892] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:22 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1682 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:23.481869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-a69a5514-9bfa-4611-992b-5656197c480c req-e2a573f5-38a8-45b1-890e-8f387e77a18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6e3975-83d1-4eed-944c-38567ce25a00", "name": "network-vif-deleted", "tag": "e2afddf9-0581-4dda-930a-1bfbd2584827"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:23.493437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-a69a5514-9bfa-4611-992b-5656197c480c req-e2a573f5-38a8-45b1-890e-8f387e77a18f service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:23.494721 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-a69a5514-9bfa-4611-992b-5656197c480c req-e2a573f5-38a8-45b1-890e-8f387e77a18f service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:23.495153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-a69a5514-9bfa-4611-992b-5656197c480c req-e2a573f5-38a8-45b1-890e-8f387e77a18f service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:23.509472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-a69a5514-9bfa-4611-992b-5656197c480c req-e2a573f5-38a8-45b1-890e-8f387e77a18f service nova] Creating event network-vif-deleted:e2afddf9-0581-4dda-930a-1bfbd2584827 for instance ab6e3975-83d1-4eed-944c-38567ce25a00 on hv-cinder-85061 Aug 10 11:30:23.519948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-a69a5514-9bfa-4611-992b-5656197c480c req-e2a573f5-38a8-45b1-890e-8f387e77a18f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042148 Aug 10 11:30:23.521234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 451/893] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:23.631085 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:23.632509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:23.635792 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:23.640484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:23.647828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:23.648880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:23.650825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:23.652759 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:23.653514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:23.654370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:23.657559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:23.658279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:23.661510 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:23.663002 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:23.663714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:23.664805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:23.749273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:23.757797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2825d549-286d-4074-a92a-e3340003d889 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1614 microversion: 2.1 time: 0.126404 Aug 10 11:30:23.763959 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 452/894] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:23 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1614 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:23.875949 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:23.888996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-83c43496-5790-4d56-b338-10253482f554 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.274338 Aug 10 11:30:23.889488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 443/895] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:23 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:23.976850 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-143927355", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62e8cbda-6c30-4481-8081-da5b43bd3e56"}], "security_groups": [{"name": "tempest-securitygroup--455403672"}], "key_name": "tempest-keypair-1484906262", "user_data": "}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:24.084837 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] validate_networks() for [('62e8cbda-6c30-4481-8081-da5b43bd3e56', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:30:24.568924 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:30:24.569530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:30:24.569830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:30:24.570234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:30:24.570642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:30:24.579903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:24.580431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:24.580869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:24.581587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:24.582297 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:24.582741 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:24.599908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Getting quotas for project 282c9e4b65d64085a0ba1a3d356f59fa. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:30:24.604832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Getting quotas for user 87adb637dd814cf8be9ff6c2a2bc26ea and project 282c9e4b65d64085a0ba1a3d356f59fa. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:30:24.615877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:30:24.618158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:30:24.785822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:24.787215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:24.790159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b74e1bb2-0b13-4374-80ba-9c8e4cbc228a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.817820 Aug 10 11:30:24.790938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 453/896] 10.222.0.13 () {62 vars in 1188 bytes} [Wed Aug 10 11:30:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 11:30:24.795284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:24.795774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:24.796370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:24.797063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:24.797508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:24.798120 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:24.801906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7c2114c9-1fd9-4e81-8c06-d46f02087b4b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:24.802630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7c2114c9-1fd9-4e81-8c06-d46f02087b4b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:24.833362 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:24.833942 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:24.834454 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:24.834978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'fault' on Instance uuid ab6e3975-83d1-4eed-944c-38567ce25a00 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:24.867267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7c2114c9-1fd9-4e81-8c06-d46f02087b4b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:24.875618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7c2114c9-1fd9-4e81-8c06-d46f02087b4b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:24.877312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7c2114c9-1fd9-4e81-8c06-d46f02087b4b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:24.878492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7c2114c9-1fd9-4e81-8c06-d46f02087b4b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1281 microversion: 2.20 time: 0.080523 Aug 10 11:30:24.879219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 454/897] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:24 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:30:24.901155 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:24.910892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-89c51208-d2b5-493a-b138-92d2e7782d47 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1332 microversion: 2.1 time: 0.129039 Aug 10 11:30:24.911115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:24.924021 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 444/898] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:24 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:24.924219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:24.924219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:24.924219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:24.924219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:24.924564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:24.924564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:24.924564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.058345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:25.065901 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-915a817e-85fd-47f7-88ee-8b179e07c22a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.159058 Aug 10 11:30:25.066452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 455/899] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:24 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:25.903006 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:25.903626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:25.910148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:25.910633 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:25.911068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.911755 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:25.912234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:25.920595 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.932503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:25.933106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:25.935470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:25.944597 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:25.945092 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:25.945543 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.946227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:25.946702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:25.947169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.976272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:25.984852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:25.988139 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:25.988139 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:25.988344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:25.988465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:25.988465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'fault' on Instance uuid ab6e3975-83d1-4eed-944c-38567ce25a00 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:25.988642 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-23798904-4c76-4884-ae56-bd4bbabde39a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1285 microversion: 2.20 time: 0.089339 Aug 10 11:30:25.989490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 445/900] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:25 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:26.031581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:26.039082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4a94f626-2325-41e6-8829-830ac78a8ded tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 200 len: 1332 microversion: 2.1 time: 0.110296 Aug 10 11:30:26.039638 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 456/901] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:25 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 1332 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:26.087128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:26.088425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:26.094635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:26.104816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:26.104816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:26.104816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:26.104816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:26.105209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:26.230795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:26.239120 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2e9e332a-ce4b-44e4-b39b-a02576e447a4 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.155905 Aug 10 11:30:26.239691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 446/902] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:26 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:27.013342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:27.014027 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:27.020702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.021187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.021624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.022313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.022763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.023190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.061753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:27.062364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:27.068760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.069246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.069680 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.070382 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.070830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.071258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.085590 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:30:27.085739 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 HTTP/1.1 Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:30:27.087358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:30:27.088760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'ab6e3975-83d1-4eed-944c-38567ce25a00'} Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:27.089500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:30:27.090869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:27.092679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:27.092679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bfcd1a6c-45b8-4700-9cdb-73ed8d399d63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 404 len: 111 microversion: 2.1 time: 0.030999 Aug 10 11:30:27.092679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 447/903] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:27 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:30:27.099329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:27.105779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:27.105779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a9b18fd9-9e34-4622-a3c1-d88c218e3b8c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1333 microversion: 2.20 time: 0.092931 Aug 10 11:30:27.105779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 457/904] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:27 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:27.110837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fb3cec7b-894a-4877-8719-097306d81bb5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '.version_select at 0x7f6f490af550>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:27.258360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fb3cec7b-894a-4877-8719-097306d81bb5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132828086" status: 202 len: 0 microversion: 2.1 time: 0.160537 Aug 10 11:30:27.260208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 448/905] 10.222.0.13 () {58 vars in 1221 bytes} [Wed Aug 10 11:30:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132828086 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:27.271302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:27.276479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:27.290117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.291352 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.291858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.292654 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:27.293206 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:27.293842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:27.504102 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:27.511839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8a278b79-5335-4fff-a4d0-a9110d41323d tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.256149 Aug 10 11:30:27.512664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 458/906] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:27 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:28.137390 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:28.137390 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:28.145932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:28.146513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:28.147023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:28.147835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:28.149111 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:28.149663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:28.234187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5cac29be-bea1-45a4-b89e-38a5d2da03dd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: .version_select at 0x7f6f4478fb80>, body: {"keypair": {"name": "tempest-keypair-2112927060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfyvF9pEAHw9z7Z6wuwdz5nng55FTPw9fFfvnGEds6m9RcW+nsS3/p6pDEcdSFTW4b85fYCgH3sHUPUS1xmXFvrDI8fYBG/fiSecAVZ3Rr2vg04batZHKLcgltj9YgF3A=="}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:28.238418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:28.249129 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:28.250724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:28.251533 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-5cac29be-bea1-45a4-b89e-38a5d2da03dd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:30:28.251979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-81d0a590-cb5a-481d-8e3c-71d51e12f3ae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1339 microversion: 2.20 time: 0.128802 Aug 10 11:30:28.252851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 449/907] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:28 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:28.255522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-5cac29be-bea1-45a4-b89e-38a5d2da03dd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for user 0782e27e2318438fbf155dfa9cb834b6 and project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:30:28.414642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5cac29be-bea1-45a4-b89e-38a5d2da03dd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184194 Aug 10 11:30:28.428935 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 459/908] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:30:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:30:28.532755 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:28.534164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:28.543174 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:28.543683 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:28.544263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:28.545768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:28.546269 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:28.546849 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:28.709098 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:28.719448 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7ddbb779-ed2b-4bd4-ac55-34bd7b4b2097 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.190629 Aug 10 11:30:28.720170 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 450/909] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:28 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:29.275525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:29.278725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:29.290133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:29.292872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:29.292872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.293088 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:29.293532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:29.294948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.323690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-a800069a-21c9-435a-9bd2-80ed8618c8da req-acc1b9e0-7391-43bc-8a0d-e0afd5ac6eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97faf99c-8b42-41ba-8242-38a47df81e60", "name": "network-vif-plugged", "status": "completed", "tag": "8afd3334-557f-4bbd-97db-30863c2d80cc"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:29.336314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-a800069a-21c9-435a-9bd2-80ed8618c8da req-acc1b9e0-7391-43bc-8a0d-e0afd5ac6eee service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:29.336990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-a800069a-21c9-435a-9bd2-80ed8618c8da req-acc1b9e0-7391-43bc-8a0d-e0afd5ac6eee service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:29.337708 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-a800069a-21c9-435a-9bd2-80ed8618c8da req-acc1b9e0-7391-43bc-8a0d-e0afd5ac6eee service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.355720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:29.359674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-a800069a-21c9-435a-9bd2-80ed8618c8da req-acc1b9e0-7391-43bc-8a0d-e0afd5ac6eee service nova] Creating event network-vif-plugged:8afd3334-557f-4bbd-97db-30863c2d80cc for instance 97faf99c-8b42-41ba-8242-38a47df81e60 on hv-cinder-85061 Aug 10 11:30:29.371116 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-a800069a-21c9-435a-9bd2-80ed8618c8da req-acc1b9e0-7391-43bc-8a0d-e0afd5ac6eee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048253 Aug 10 11:30:29.373456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 451/910] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:30:29.552587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:29.561766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:29.563928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:29.565134 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cad1221a-dd17-463e-957d-db51994f8708 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.294394 Aug 10 11:30:29.565690 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 460/911] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:29 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:30:29.742987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:29.743784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:29.752131 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:29.752617 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:29.753053 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.753746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:29.754193 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:29.754617 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.800648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-95fa1fcf-a124-4051-af03-0a306515ae9d req-9e0a0b11-c144-461a-bbc6-8a149e12b3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad2cec8c-8c64-40a9-b670-ad87c1fd610a", "tag": "bd96a90b-c857-43bf-8f27-2546cc225d06"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:29.814247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-95fa1fcf-a124-4051-af03-0a306515ae9d req-9e0a0b11-c144-461a-bbc6-8a149e12b3b5 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:29.815150 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-95fa1fcf-a124-4051-af03-0a306515ae9d req-9e0a0b11-c144-461a-bbc6-8a149e12b3b5 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:29.815581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-95fa1fcf-a124-4051-af03-0a306515ae9d req-9e0a0b11-c144-461a-bbc6-8a149e12b3b5 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:29.829841 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-95fa1fcf-a124-4051-af03-0a306515ae9d req-9e0a0b11-c144-461a-bbc6-8a149e12b3b5 service nova] Creating event network-changed:bd96a90b-c857-43bf-8f27-2546cc225d06 for instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a on hv-cinder-85061 Aug 10 11:30:29.838274 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-95fa1fcf-a124-4051-af03-0a306515ae9d req-9e0a0b11-c144-461a-bbc6-8a149e12b3b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041513 Aug 10 11:30:29.839071 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 461/912] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:30:29.975769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:29.983382 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6411666a-5c13-46d0-915e-819794b9685c tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.245157 Aug 10 11:30:29.983923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 452/913] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:29 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:30.588888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:30.589619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:30.596886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:30.597465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:30.598058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:30.598776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:30.599377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:30.599682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:30.769305 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:30.777649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:30.779146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:30.780281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6704c0af-ea08-4e92-b9dc-79db2f054264 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.195850 Aug 10 11:30:30.780842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 462/914] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:30 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:31.004773 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:31.005385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:31.012186 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:31.015431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:31.015431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:31.015431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:31.015431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:31.015772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:31.154824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:31.162270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b7d1a612-098a-4880-a06b-e68bcf67d8ba tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.161898 Aug 10 11:30:31.162828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 453/915] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:30 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:31.517826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-235405691", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24c11727-9280-4b85-b477-78482251b877"}], "security_groups": [{"name": "tempest-securitygroup--533803741"}], "key_name": "tempest-keypair-2112927060", "user_data": "}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:31.664433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] validate_networks() for [('24c11727-9280-4b85-b477-78482251b877', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:30:31.807868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:31.808593 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:31.814479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:31.814961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:31.815391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:31.816325 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:31.816826 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:31.822154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:32.019989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:32.028703 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:32.030257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:32.031408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8f5d6a98-707d-4881-a603-f9b88efba6a9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.227941 Aug 10 11:30:32.031978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 454/916] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:31 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:30:32.109587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:30:32.110007 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:30:32.110503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:30:32.110909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:30:32.111313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:30:32.120244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:32.120717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:32.121146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:32.121859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:32.122306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:32.122725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:32.139215 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:30:32.143065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for user 0782e27e2318438fbf155dfa9cb834b6 and project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:30:32.155801 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:30:32.158083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:30:32.184574 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:32.185201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:32.191307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:32.191797 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:32.192266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:32.192965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:32.193418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:32.193864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:32.332674 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-440f97b6-0d14-4a20-95ff-0f8a7c2fd731 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.819061 Aug 10 11:30:32.333644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 463/917] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:30:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:30:32.344736 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-48bb38d9-1654-4b82-8942-02ead58dc40a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:32.345478 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-48bb38d9-1654-4b82-8942-02ead58dc40a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:32.440582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-48bb38d9-1654-4b82-8942-02ead58dc40a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:32.449640 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:32.452120 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-48bb38d9-1654-4b82-8942-02ead58dc40a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1241 microversion: 2.1 time: 0.111039 Aug 10 11:30:32.454363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 464/918] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:32 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:32.468095 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9d853227-496f-43d1-b8ce-549c8b008b43 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1575 microversion: 2.1 time: 0.287343 Aug 10 11:30:32.468687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 455/919] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:32 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1575 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:33.054180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:33.054789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:33.061949 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.062433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.062869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.063567 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.064040 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.064470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.196300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:33.204378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:33.205877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:33.207221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-88a5b633-b42e-4867-91e9-0c9dfaa43a83 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.156726 Aug 10 11:30:33.207792 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 465/920] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:33 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:33.475658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:33.476306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:33.483381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.483872 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.484560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.485050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.485502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.485936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.489720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:33.490328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:33.496420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.496904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.497333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.498018 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:33.498464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:33.498880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:33.553456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:33.561137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-21139842-73fa-4cc0-a50d-24c185e217a1 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1245 microversion: 2.1 time: 0.089525 Aug 10 11:30:33.561707 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 456/921] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:33 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:33.648840 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:33.657661 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-55b55440-7119-435b-a560-1e5c8a0e9c6f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1562 microversion: 2.1 time: 0.171698 Aug 10 11:30:33.658222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 466/922] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:33 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1562 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:34.229873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:34.234260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:34.234260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:34.237545 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:34.238029 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:34.238463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:34.239154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:34.239599 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:34.240052 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:34.378820 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:34.387503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:34.389257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:34.390356 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3ee82454-654c-44bb-9bad-a5169ed9eeec tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.164734 Aug 10 11:30:34.390910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 457/923] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:34 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:34.581960 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:34.582837 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:34.589354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:34.589843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:34.590285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:34.591044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:34.591433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:34.591856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:34.652144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:34.659483 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fef2926e-2541-4d19-85c6-fa67b77b88a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1245 microversion: 2.1 time: 0.081454 Aug 10 11:30:34.660065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 467/924] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:34 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:35.418680 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:35.419326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:35.425574 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:35.426054 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:35.426481 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:35.427160 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:35.427605 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:35.428060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:35.568064 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:35.575941 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:35.577505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:35.578595 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-368c3b37-888e-47d8-a760-072db6d9e693 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.164815 Aug 10 11:30:35.579317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 458/925] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:35 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:35.680463 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:35.681070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:35.687423 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:35.687966 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:35.688440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:35.689130 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:35.689609 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:35.690037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:35.760355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:35.760355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ec1cbf81-6496-416f-ae65-89f756e26bc4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1245 microversion: 2.1 time: 0.083626 Aug 10 11:30:35.761040 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 468/926] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:35 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:36.612876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:36.613481 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:36.620451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:36.620933 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:36.621371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:36.622056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:36.622507 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:36.622931 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:36.757353 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:36.766447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:36.767980 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:36.769563 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2125509c-251c-4693-95e8-136703948db3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.160130 Aug 10 11:30:36.770322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 459/927] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:36 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:36.780804 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:36.781506 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:36.787849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:36.788362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:36.788796 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:36.789481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:36.789931 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:36.790983 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:36.852473 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:36.860479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-72e995e8-70e1-4802-9605-395aeeba8e21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1293 microversion: 2.1 time: 0.083514 Aug 10 11:30:36.861047 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 469/928] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:36 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:37.497509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-747be3e7-8c71-4ea6-8394-fd12db45ab98 req-2ab1a1d0-1556-4003-92c0-e434c600c1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2cec8c-8c64-40a9-b670-ad87c1fd610a", "name": "network-vif-plugged", "status": "completed", "tag": "bd96a90b-c857-43bf-8f27-2546cc225d06"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:37.507186 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-747be3e7-8c71-4ea6-8394-fd12db45ab98 req-2ab1a1d0-1556-4003-92c0-e434c600c1da service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:37.507666 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-747be3e7-8c71-4ea6-8394-fd12db45ab98 req-2ab1a1d0-1556-4003-92c0-e434c600c1da service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:37.508116 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-747be3e7-8c71-4ea6-8394-fd12db45ab98 req-2ab1a1d0-1556-4003-92c0-e434c600c1da service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:37.519796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-747be3e7-8c71-4ea6-8394-fd12db45ab98 req-2ab1a1d0-1556-4003-92c0-e434c600c1da service nova] Creating event network-vif-plugged:bd96a90b-c857-43bf-8f27-2546cc225d06 for instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a on hv-cinder-85061 Aug 10 11:30:37.525425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-747be3e7-8c71-4ea6-8394-fd12db45ab98 req-2ab1a1d0-1556-4003-92c0-e434c600c1da service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031392 Aug 10 11:30:37.526105 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 460/929] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:30:37.794303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:37.794909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:37.801376 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:37.805172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:37.805172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:37.805172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:37.805172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:37.805552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:37.882044 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:37.882830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:37.890931 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:37.891407 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:37.891830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:37.892570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:37.893092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:37.893514 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:38.084630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:38.097385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:38.099415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:38.100779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-edc98532-f285-4bc4-96b7-d8f11b1a1806 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.310866 Aug 10 11:30:38.101541 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 470/930] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:37 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:38.140087 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:38.148149 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-883df13e-e121-4adf-9bbd-13995b371e0f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.270346 Aug 10 11:30:38.148760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 461/931] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:37 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:39.123283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:39.123916 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:39.130221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:39.130699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:39.131128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:39.131818 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:39.132302 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:39.132724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:39.172661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:39.173195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:39.179643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:39.180202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:39.180631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:39.181997 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:39.182446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:39.182864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:39.402103 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:39.414562 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:39.420292 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:39.421988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:39.423462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a5b8f127-f401-421a-8a6c-995999208294 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1406 microversion: 2.20 time: 0.304645 Aug 10 11:30:39.424219 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fd7e4d1a-8a19-4332-8855-3a64d15feee2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.255401 Aug 10 11:30:39.424433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 471/932] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:39 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:39.425231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 462/933] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:39 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:39.546321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-39413ed7-a0ed-4c30-94f8-e3b9d1614f9e req-ae05fae5-f5b3-45b7-8fbe-9f1b6d470cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5007f939-3f30-4d48-b73a-97e538672837", "tag": "daa1370a-f0e8-4ff0-b081-32134fae5ca0"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:39.555608 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-39413ed7-a0ed-4c30-94f8-e3b9d1614f9e req-ae05fae5-f5b3-45b7-8fbe-9f1b6d470cc7 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:39.556379 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-39413ed7-a0ed-4c30-94f8-e3b9d1614f9e req-ae05fae5-f5b3-45b7-8fbe-9f1b6d470cc7 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:39.556821 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-39413ed7-a0ed-4c30-94f8-e3b9d1614f9e req-ae05fae5-f5b3-45b7-8fbe-9f1b6d470cc7 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:39.578746 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-39413ed7-a0ed-4c30-94f8-e3b9d1614f9e req-ae05fae5-f5b3-45b7-8fbe-9f1b6d470cc7 service nova] Creating event network-changed:daa1370a-f0e8-4ff0-b081-32134fae5ca0 for instance 5007f939-3f30-4d48-b73a-97e538672837 on hv-cinder-85061 Aug 10 11:30:39.587825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-39413ed7-a0ed-4c30-94f8-e3b9d1614f9e req-ae05fae5-f5b3-45b7-8fbe-9f1b6d470cc7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043755 Aug 10 11:30:39.588787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 472/934] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:40.451357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:40.454070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:40.455172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:40.460123 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:40.467635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:40.468178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:40.468615 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:40.469324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:40.469776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:40.470200 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:40.476327 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:40.476857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:40.478574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:40.478720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:40.479289 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:40.479714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:40.494975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:40.700380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:40.703533 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:40.709222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:40.710894 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:40.711325 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8cd91f25-8438-41e4-9a08-ff43ed566c18 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.267734 Aug 10 11:30:40.711906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 473/935] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:40 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:40.712210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-31c16175-f61b-4d3c-8d48-94dc4bbd9ba3 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1598 microversion: 2.20 time: 0.270262 Aug 10 11:30:40.712759 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 463/936] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:30:40 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1598 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:30:40.735452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:40.735942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:40.741786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:40.746278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:40.746278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:40.746278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:40.746278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:40.746619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:40.820791 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f3945568-2adb-481c-8792-45e54e116b98 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089064 Aug 10 11:30:40.821434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 474/937] 10.222.0.13 () {60 vars in 1316 bytes} [Wed Aug 10 11:30:40 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:30:41.733881 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:41.733881 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:41.739424 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:41.739901 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:41.740358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:41.741062 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:41.741514 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:41.741989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:41.983453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:41.989362 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-54ede6dc-91df-4860-a295-d37df65372e2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.260647 Aug 10 11:30:41.989867 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 464/938] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:41 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:42.241787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:42.246338 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-8a6def56-c38c-48e9-a975-dbc16eb76cda req-0368e354-12e1-44e7-acf2-f44a998b36e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad2cec8c-8c64-40a9-b670-ad87c1fd610a", "tag": "bd96a90b-c857-43bf-8f27-2546cc225d06"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:42.255440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-8a6def56-c38c-48e9-a975-dbc16eb76cda req-0368e354-12e1-44e7-acf2-f44a998b36e8 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:42.256069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-8a6def56-c38c-48e9-a975-dbc16eb76cda req-0368e354-12e1-44e7-acf2-f44a998b36e8 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:42.256452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-8a6def56-c38c-48e9-a975-dbc16eb76cda req-0368e354-12e1-44e7-acf2-f44a998b36e8 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:42.268802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-8a6def56-c38c-48e9-a975-dbc16eb76cda req-0368e354-12e1-44e7-acf2-f44a998b36e8 service nova] Creating event network-changed:bd96a90b-c857-43bf-8f27-2546cc225d06 for instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a on hv-cinder-85061 Aug 10 11:30:42.276701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-8a6def56-c38c-48e9-a975-dbc16eb76cda req-0368e354-12e1-44e7-acf2-f44a998b36e8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033652 Aug 10 11:30:42.277659 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 475/939] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:43.011451 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:43.012147 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:43.019325 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:43.019809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:43.022369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:43.022369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:43.022369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:43.022369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:43.166497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:43.175623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-90cbed0f-6a90-4fdb-9ed1-08bd04af3bec tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.168794 Aug 10 11:30:43.178439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 465/940] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:43 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:43.215873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=24 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:43.450660 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1968794094"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:43.451299 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:43.457742 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:43.458300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:43.458732 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:43.459451 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:43.459895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:43.460366 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:43.587635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.network.security_group_api [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Removing security group 11004a7c-2f10-471e-99ff-1df8ef0ec485 from port fb19c135-b6e1-4aab-9034-c28ae9b55761 Aug 10 11:30:43.981550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2fbcf9bb-2604-43d2-83f6-d6c9207805e0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "POST /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/action" status: 202 len: 0 microversion: 2.1 time: 0.770743 Aug 10 11:30:43.982174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 476/941] 10.222.0.13 () {60 vars in 1278 bytes} [Wed Aug 10 11:30:43 2022] POST /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:44.198059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:44.198710 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:44.207076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:44.225775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:44.225775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:44.225775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:44.225775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:44.226509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:44.325118 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-b8be9a41-3b3e-4e42-a39b-386e77c3585c req-ac5d15c9-f6f8-4697-80c8-c141ddbf9cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34add072-ed4f-4601-b02e-e5b98edbb970", "tag": "fb19c135-b6e1-4aab-9034-c28ae9b55761"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:44.353563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-b8be9a41-3b3e-4e42-a39b-386e77c3585c req-ac5d15c9-f6f8-4697-80c8-c141ddbf9cd8 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:44.354065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-b8be9a41-3b3e-4e42-a39b-386e77c3585c req-ac5d15c9-f6f8-4697-80c8-c141ddbf9cd8 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:44.354604 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-b8be9a41-3b3e-4e42-a39b-386e77c3585c req-ac5d15c9-f6f8-4697-80c8-c141ddbf9cd8 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:44.372335 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-b8be9a41-3b3e-4e42-a39b-386e77c3585c req-ac5d15c9-f6f8-4697-80c8-c141ddbf9cd8 service nova] Creating event network-changed:fb19c135-b6e1-4aab-9034-c28ae9b55761 for instance 34add072-ed4f-4601-b02e-e5b98edbb970 on hv-cinder-85061 Aug 10 11:30:44.378741 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-b8be9a41-3b3e-4e42-a39b-386e77c3585c req-ac5d15c9-f6f8-4697-80c8-c141ddbf9cd8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062011 Aug 10 11:30:44.379675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 477/942] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:44.481498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:44.489362 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3594b41a-41c4-426b-9b21-e498216c3d1e tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.295847 Aug 10 11:30:44.490554 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 466/943] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:44 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:44.716170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:44.718843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:44.727592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:44.728749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:44.729198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:44.729923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:44.730474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:44.731085 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:44.766175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-72a22222-1e66-4738-8355-a6ed41dd4b1b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054560 Aug 10 11:30:44.766989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 478/944] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:44 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:30:44.840662 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:44.841204 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:44.847692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:44.848240 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:44.848715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:44.849428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:44.849887 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:44.850310 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:44.879165 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:30:45.004394 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:45.232892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-02429756-a7b6-4f70-8007-b71495d75cde tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 204 len: 0 microversion: 2.1 time: 0.396131 Aug 10 11:30:45.233686 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 467/945] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:30:44 2022] DELETE /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:30:45.242055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:45.242813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:45.250346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:45.250847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:45.251510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:45.252454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:45.253145 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:45.253796 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:45.413461 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:45.422392 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-086b27c0-c3ad-4d0a-92e3-1f96124116e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1673 microversion: 2.1 time: 0.184273 Aug 10 11:30:45.422972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 479/946] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:45 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1673 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:45.511960 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:45.512626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:45.518836 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:45.519320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:45.519786 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:45.520502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:45.520961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:45.521387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:45.670768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:45.678308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a11eaf1b-e890-4c52-8176-11647f0fc9ba tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.171401 Aug 10 11:30:45.682996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 468/947] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:45 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:45.973859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:45.974436 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:45.976312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-9ed648e6-288d-44a7-a21b-8d08b1da2e44 req-f34e469a-9531-445c-ad66-4e2779eece1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34add072-ed4f-4601-b02e-e5b98edbb970", "tag": "fb19c135-b6e1-4aab-9034-c28ae9b55761"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:45.981355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:45.982246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:45.982706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:45.983395 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:45.984034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:45.984457 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:45.987263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9ed648e6-288d-44a7-a21b-8d08b1da2e44 req-f34e469a-9531-445c-ad66-4e2779eece1c service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:45.987827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9ed648e6-288d-44a7-a21b-8d08b1da2e44 req-f34e469a-9531-445c-ad66-4e2779eece1c service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:45.988497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9ed648e6-288d-44a7-a21b-8d08b1da2e44 req-f34e469a-9531-445c-ad66-4e2779eece1c service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:45.999881 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-9ed648e6-288d-44a7-a21b-8d08b1da2e44 req-f34e469a-9531-445c-ad66-4e2779eece1c service nova] Creating event network-changed:fb19c135-b6e1-4aab-9034-c28ae9b55761 for instance 34add072-ed4f-4601-b02e-e5b98edbb970 on hv-cinder-85061 Aug 10 11:30:46.005911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-9ed648e6-288d-44a7-a21b-8d08b1da2e44 req-f34e469a-9531-445c-ad66-4e2779eece1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033626 Aug 10 11:30:46.011127 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 469/948] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:46.069015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lazy-loading 'services' on Instance uuid 34add072-ed4f-4601-b02e-e5b98edbb970 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:46.445270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:46.450484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:46.455934 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-59c92386-c120-4302-b095-e1cb8d6c3c4e tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "DELETE /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments/197679ff-36b6-4241-89ef-23f7bdaf9f59" status: 202 len: 0 microversion: 2.1 time: 0.485944 Aug 10 11:30:46.460273 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:46.461084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 480/949] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:30:45 2022] DELETE /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments/197679ff-36b6-4241-89ef-23f7bdaf9f59 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:46.461745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:46.462910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:46.463890 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:46.470399 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:46.471081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:46.471923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:46.477436 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:46.496729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:46.497357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:46.497864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:46.498823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:46.499351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:46.500087 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:46.552114 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f8eb729c-942b-4385-a58d-1ff5c79e5f04 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085780 Aug 10 11:30:46.552869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 481/950] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:46 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:46.647681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:46.658463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7f039b2a-d965-4430-8f48-1a30fc004118 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1673 microversion: 2.1 time: 0.217838 Aug 10 11:30:46.659239 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 470/951] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:46 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:46.698952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:46.699776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:46.705764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:46.706256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:46.706785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:46.707763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:46.708244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:46.708676 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:46.862938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:46.873179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5b6f699d-ab7e-49c2-8e1d-b87fe1bd1c02 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.178296 Aug 10 11:30:46.873938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 482/952] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:46 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:47.565499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:47.569312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:47.577874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:47.583363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:47.583880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:47.584638 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:47.585096 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:47.585691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:47.621228 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-64a49449-8882-4c9b-8d08-06ecbf892242 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059684 Aug 10 11:30:47.622009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 471/953] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:47 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:47.682360 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:47.683061 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:47.689720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:47.690543 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:47.691191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:47.692031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:47.692605 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:47.693146 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:47.886014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-97ae1341-3ebf-440b-b096-b7a8ea686dc3 req-e0af5d87-9e74-4112-9a08-07c771bf6ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5007f939-3f30-4d48-b73a-97e538672837", "name": "network-vif-plugged", "status": "completed", "tag": "daa1370a-f0e8-4ff0-b081-32134fae5ca0"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:47.901025 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-97ae1341-3ebf-440b-b096-b7a8ea686dc3 req-e0af5d87-9e74-4112-9a08-07c771bf6ecf service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:47.901570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-97ae1341-3ebf-440b-b096-b7a8ea686dc3 req-e0af5d87-9e74-4112-9a08-07c771bf6ecf service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:47.901997 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-97ae1341-3ebf-440b-b096-b7a8ea686dc3 req-e0af5d87-9e74-4112-9a08-07c771bf6ecf service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:47.913854 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-97ae1341-3ebf-440b-b096-b7a8ea686dc3 req-e0af5d87-9e74-4112-9a08-07c771bf6ecf service nova] Creating event network-vif-plugged:daa1370a-f0e8-4ff0-b081-32134fae5ca0 for instance 5007f939-3f30-4d48-b73a-97e538672837 on hv-cinder-85061 Aug 10 11:30:47.920746 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-97ae1341-3ebf-440b-b096-b7a8ea686dc3 req-e0af5d87-9e74-4112-9a08-07c771bf6ecf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041506 Aug 10 11:30:47.921977 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 472/954] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:30:47.930010 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:47.930378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:47.939089 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:47.939830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:47.941185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:47.942045 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:47.942717 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:47.943329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:48.024327 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:48.034037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-723c36d9-4da9-4b22-b989-6e55049fe444 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1673 microversion: 2.1 time: 0.357019 Aug 10 11:30:48.037866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 483/955] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:47 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1673 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:48.134512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:48.142578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e1b42570-9cd6-4f89-b2a7-83ced939e2af tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.219280 Aug 10 11:30:48.143202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 473/956] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:47 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:48.633663 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:48.636588 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:48.644292 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:48.644783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:48.645250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:48.646000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:48.646580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:48.647053 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:48.677170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9386a6d1-7c89-418f-996b-d2d656b412c0 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047526 Aug 10 11:30:48.677727 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 484/957] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:30:48 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:30:48.689000 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:48.689539 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:48.700164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:48.700662 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:48.701104 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:48.701813 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:48.702279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:48.702732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:48.781033 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] HTTP exception thrown: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 is not attached to volume 197679ff-36b6-4241-89ef-23f7bdaf9f59 Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Request method failure captured: Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments/197679ff-36b6-4241-89ef-23f7bdaf9f59 HTTP/1.1 Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85WGqZVCzXYlY6bPkeLabuXvE_lXQugpStd5zK1erBoJz9dMg_9s1yX1fcRpXBey26pBNSVUq4U030u2fdfMBj4DPkUVy4sprIcjmoxEzceGjsZW9cn-83u_Ia-UQJWo4mGpKVTGjDnCVeYdf7B6rSkkv9Fzw8nMSkjZqcOfF8e4U-A Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: e202fe4250104681a9fe73fc4750c33f Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-TestMinimumBasicScenario-2141608139 Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:30:48.784211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e202fe4250104681a9fe73fc4750c33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e202fe4250104681a9fe73fc4750c33f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e202fe4250104681a9fe73fc4750c33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e202fe4250104681a9fe73fc4750c33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-TestMinimumBasicScenario-2141608139 Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: e202fe4250104681a9fe73fc4750c33f Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2141608139 Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-TestMinimumBasicScenario-2141608139-project Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: e49a2b5153b04661b3ef6fe699867005 Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-TestMinimumBasicScenario-2141608139-project Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:30:48.785551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 is not attached to volume 197679ff-36b6-4241-89ef-23f7bdaf9f59 Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'server_id': '34add072-ed4f-4601-b02e-e5b98edbb970', 'id': '197679ff-36b6-4241-89ef-23f7bdaf9f59'} Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 197679ff-36b6-4241-89ef-23f7bdaf9f59. Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:48.786231 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 is not attached to volume 197679ff-36b6-4241-89ef-23f7bdaf9f59 Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 is not attached to volume 197679ff-36b6-4241-89ef-23f7bdaf9f59 Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:48.787932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Returning 404 to user: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 is not attached to volume 197679ff-36b6-4241-89ef-23f7bdaf9f59 {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:48.789624 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c6937bf7-c253-4e78-8cda-fef85b52d946 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "DELETE /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments/197679ff-36b6-4241-89ef-23f7bdaf9f59" status: 404 len: 154 microversion: 2.1 time: 0.101015 Aug 10 11:30:48.790801 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 474/958] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:30:48 2022] DELETE /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970/os-volume_attachments/197679ff-36b6-4241-89ef-23f7bdaf9f59 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:30:48.839084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-30288c63-61fb-4166-8123-6ab5a011388c req-089306cd-4441-46c4-9a15-246c6d56395a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6aeb94b-88c4-4f5c-844a-5fff3d2848dc", "name": "network-vif-deleted", "tag": "a52cecc3-421d-4a63-a257-b873728af199"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:48.848830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-30288c63-61fb-4166-8123-6ab5a011388c req-089306cd-4441-46c4-9a15-246c6d56395a service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:48.849304 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-30288c63-61fb-4166-8123-6ab5a011388c req-089306cd-4441-46c4-9a15-246c6d56395a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:48.849732 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-30288c63-61fb-4166-8123-6ab5a011388c req-089306cd-4441-46c4-9a15-246c6d56395a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:48.861322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-30288c63-61fb-4166-8123-6ab5a011388c req-089306cd-4441-46c4-9a15-246c6d56395a service nova] Creating event network-vif-deleted:a52cecc3-421d-4a63-a257-b873728af199 for instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc on hv-cinder-85061 Aug 10 11:30:48.866382 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-30288c63-61fb-4166-8123-6ab5a011388c req-089306cd-4441-46c4-9a15-246c6d56395a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031263 Aug 10 11:30:48.866958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 485/959] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:49.059129 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:49.059740 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:49.065911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:49.066389 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:49.066879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:49.067512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:49.067954 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:49.068433 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:49.135676 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:49.143319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-391f4f57-e3ef-4eca-a4d3-d2edc075185f tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1605 microversion: 2.1 time: 0.089404 Aug 10 11:30:49.144084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 475/960] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:49 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1605 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:49.164940 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:49.166312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:49.172399 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:49.172878 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:49.173309 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:49.173990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:49.174454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:49.174853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:49.313638 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:49.321509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d4e7e106-d3d0-4474-83b2-4438eed8e67c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.160773 Aug 10 11:30:49.322102 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 486/961] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:49 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:50.148578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:50.149051 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:50.156265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.156855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.157391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.158095 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.158553 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.158983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.165742 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:50.166375 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:50.172985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.173476 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.174247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.174710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.175169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.175625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.190439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:30:50.213008 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.213503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.213933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.214377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lazy-loading 'fault' on Instance uuid b6aeb94b-88c4-4f5c-844a-5fff3d2848dc {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:50.262895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:50.270621 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-da1c1fa7-784c-4348-8ae9-b1c54968e895 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1327 microversion: 2.1 time: 0.108782 Aug 10 11:30:50.271122 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 487/962] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:50 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:50.349517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:50.350336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:50.360855 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.361355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.361794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.362528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.362988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.364562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.507374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:50.516475 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-84a6e70d-c40d-45d9-b0ff-14b2afe785bf tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1366 microversion: 2.1 time: 0.177503 Aug 10 11:30:50.517421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 488/963] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:50 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:50.559691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4a40ad96-de8f-409c-9006-b86b0b648c62 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "DELETE /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 204 len: 0 microversion: 2.1 time: 0.414566 Aug 10 11:30:50.560252 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 476/964] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:30:50 2022] DELETE /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:30:50.568475 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:50.569164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:50.575219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.575862 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.576401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.577167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:50.577658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:50.578117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:50.732254 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:50.739797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-962c4d34-8bac-4b96-a509-3d1261d173b7 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1554 microversion: 2.1 time: 0.175210 Aug 10 11:30:50.745119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 489/965] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:50 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:51.292011 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:51.292738 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:51.299408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.299950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.300428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.301118 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.301622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.302047 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.335714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.336286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.336765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.337207 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lazy-loading 'fault' on Instance uuid b6aeb94b-88c4-4f5c-844a-5fff3d2848dc {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:51.380249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:51.388495 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c9747cd5-f8dc-4f5a-84a3-8cfa662e29eb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1327 microversion: 2.1 time: 0.101188 Aug 10 11:30:51.389254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 477/966] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:51 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:51.538231 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:51.538973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:51.542129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:51.547126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.547620 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.548091 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.548859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.549319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.549752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.690490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:51.699464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-84840555-94fb-481e-b813-8c08b272140f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1556 microversion: 2.1 time: 0.165215 Aug 10 11:30:51.700052 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 490/967] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:51 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:51.721253 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:51.721729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:51.728739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.731292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.731292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.731292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.731292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.731601 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.766684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:51.767286 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:51.773998 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.774568 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.775903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.776987 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:51.777544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:51.778025 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:51.797208 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:30:51.820996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-50472211-eea9-4fdd-8f24-f7043aa4474f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103583 Aug 10 11:30:51.822358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 478/968] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 10 11:30:51 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:51.931668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:51.941617 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-716d5df6-cb46-4313-be77-3bc16e7ca42d tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1554 microversion: 2.1 time: 0.178718 Aug 10 11:30:51.942250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 491/969] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:51 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:30:52.410020 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:52.410623 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:52.421380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:52.421858 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:52.422293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:52.422992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:52.423642 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:52.424496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:52.459110 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:52.459761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:52.460330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:52.460878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lazy-loading 'fault' on Instance uuid b6aeb94b-88c4-4f5c-844a-5fff3d2848dc {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:52.506099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:52.515782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3a4f2a61-9d91-4541-bfc6-5249f832fa43 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1327 microversion: 2.1 time: 0.109506 Aug 10 11:30:52.516687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 479/970] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:52 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:52.964715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:52.965650 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:52.972937 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:52.973563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:52.974141 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:52.974957 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:52.975526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:52.976322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:53.137625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:53.148625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f76c6c25-a28b-4d0e-ac8d-389559ed04e5 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1554 microversion: 2.1 time: 0.188922 Aug 10 11:30:53.149226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 492/971] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:52 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:53.318818 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-30dda13e-e666-44a6-820c-5e64df240900 req-d2d79909-71e5-46bb-8fac-68aac11286f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5007f939-3f30-4d48-b73a-97e538672837", "tag": "daa1370a-f0e8-4ff0-b081-32134fae5ca0"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:53.333727 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-30dda13e-e666-44a6-820c-5e64df240900 req-d2d79909-71e5-46bb-8fac-68aac11286f3 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:53.334453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-30dda13e-e666-44a6-820c-5e64df240900 req-d2d79909-71e5-46bb-8fac-68aac11286f3 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:53.335208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-30dda13e-e666-44a6-820c-5e64df240900 req-d2d79909-71e5-46bb-8fac-68aac11286f3 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:53.351229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-30dda13e-e666-44a6-820c-5e64df240900 req-d2d79909-71e5-46bb-8fac-68aac11286f3 service nova] Creating event network-changed:daa1370a-f0e8-4ff0-b081-32134fae5ca0 for instance 5007f939-3f30-4d48-b73a-97e538672837 on hv-cinder-85061 Aug 10 11:30:53.356899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-30dda13e-e666-44a6-820c-5e64df240900 req-d2d79909-71e5-46bb-8fac-68aac11286f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041973 Aug 10 11:30:53.357500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 480/972] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:53.538464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:53.539002 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:53.545366 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:53.548982 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:53.554106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:53.555207 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:53.555838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:53.556459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:53.615082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:53.615838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:53.616517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:53.617129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lazy-loading 'fault' on Instance uuid b6aeb94b-88c4-4f5c-844a-5fff3d2848dc {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:53.686668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:53.696273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a868305b-8c70-4371-a189-24adfbe9bbe5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 200 len: 1327 microversion: 2.1 time: 0.162816 Aug 10 11:30:53.700738 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 493/973] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:53 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:54.175175 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:54.175887 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:54.190611 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:54.191349 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:54.192745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:54.201734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:54.202396 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:54.203165 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:54.384466 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:54.396714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-69e48b75-d65c-412c-bb97-8fcd06977255 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1554 microversion: 2.1 time: 0.227389 Aug 10 11:30:54.398447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 481/974] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:54 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:54.719310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:54.719922 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:54.727794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:54.728351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:54.728793 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:54.729587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:54.730041 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:54.730465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:54.745278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] HTTP exception thrown: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Request method failure captured: Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc HTTP/1.1 Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UBx0SBh_Bv3GYHZagmfVQqa3oPIcTnBcahS1P_fNrccGkpNpXTwuhXAZAOaTUECMgMF_-kMnSsi0ieebYQAWSzIWCNNwVrvJezFkIZqFd9KGfCXD4HprMa0l40jBFIlIUKZvSp5GCQLLlst0Q01BCO28X-PqCQqc0kg7mAYC19j_w Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:30:54.756343 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/362ec4487088496a8198a3cf71815256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_362ec4487088496a8198a3cf71815256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 11be37af210c45fc9ddebf7f28b265ef Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:30:54.757928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'b6aeb94b-88c4-4f5c-844a-5fff3d2848dc'} Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:54.758839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:30:54.760385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:30:54.762490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Returning 404 to user: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:54.762490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dec5941d-e988-41ef-a9ed-e88cbf0739fb tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 404 len: 111 microversion: 2.1 time: 0.033177 Aug 10 11:30:54.762490 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 494/975] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:54 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:30:54.762734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4fb95976-8abc-489c-9aec-6705733d2fba tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '.version_select at 0x7f6f44398280>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:54.947567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4fb95976-8abc-489c-9aec-6705733d2fba tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-313909988" status: 202 len: 0 microversion: 2.1 time: 0.193535 Aug 10 11:30:54.948702 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 482/976] 10.222.0.13 () {58 vars in 1218 bytes} [Wed Aug 10 11:30:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-313909988 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:55.380888 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-854fb20a-4933-468c-b202-2e807fe72aa9 req-a364d324-ea10-48ed-8d51-021c0624b881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34add072-ed4f-4601-b02e-e5b98edbb970", "name": "network-vif-deleted", "tag": "fb19c135-b6e1-4aab-9034-c28ae9b55761"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:55.391158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-854fb20a-4933-468c-b202-2e807fe72aa9 req-a364d324-ea10-48ed-8d51-021c0624b881 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:55.391894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-854fb20a-4933-468c-b202-2e807fe72aa9 req-a364d324-ea10-48ed-8d51-021c0624b881 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:55.392357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-854fb20a-4933-468c-b202-2e807fe72aa9 req-a364d324-ea10-48ed-8d51-021c0624b881 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:55.405454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-854fb20a-4933-468c-b202-2e807fe72aa9 req-a364d324-ea10-48ed-8d51-021c0624b881 service nova] Creating event network-vif-deleted:fb19c135-b6e1-4aab-9034-c28ae9b55761 for instance 34add072-ed4f-4601-b02e-e5b98edbb970 on hv-cinder-85061 Aug 10 11:30:55.411558 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-854fb20a-4933-468c-b202-2e807fe72aa9 req-a364d324-ea10-48ed-8d51-021c0624b881 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034326 Aug 10 11:30:55.414051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 495/977] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:55.420122 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:55.420770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:55.428343 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:55.428833 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:55.430417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:55.431152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:55.432026 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:55.432488 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:55.473530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:55.474178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:55.474802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:55.475254 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lazy-loading 'fault' on Instance uuid 34add072-ed4f-4601-b02e-e5b98edbb970 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:30:55.530460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e49a2b5153b04661b3ef6fe699867005', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e202fe4250104681a9fe73fc4750c33f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:30:55.538708 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d87b7ccf-a6f3-41b7-9bdc-18433fc9583f tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 200 len: 1347 microversion: 2.1 time: 0.123705 Aug 10 11:30:55.540077 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 483/978] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:55 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 1347 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:30:55.951508 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0a268c8c-0275-4293-9285-2c518e9fd652 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'create', calling method: .version_select at 0x7f6f44730040>, body: {"keypair": {"name": "tempest-keypair-379378277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJu7ewFg/QGCGSXUTrVF1Le0j256mfnY/ETrNaeCdfaz3KVucWrMETO0PGeo1A+ZRbQ57Ea8Nimp92HWRSGA5AIDIYZGA6dru6n3P/Glt/4MPm+0Y+zBcuHs9KFOaqFQ9Q=="}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:30:55.967808 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-0a268c8c-0275-4293-9285-2c518e9fd652 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Getting quotas for project 362ec4487088496a8198a3cf71815256. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:30:55.972988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-0a268c8c-0275-4293-9285-2c518e9fd652 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Getting quotas for user 11be37af210c45fc9ddebf7f28b265ef and project 362ec4487088496a8198a3cf71815256. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:30:56.294632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0a268c8c-0275-4293-9285-2c518e9fd652 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.348662 Aug 10 11:30:56.295528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 496/979] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:30:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:30:56.560935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:56.568734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] [instance: 34add072-ed4f-4601-b02e-e5b98edbb970] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:30:56.568734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:56.568962 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:56.569260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:56.569951 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:30:56.570401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:30:56.570822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:30:56.588112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] HTTP exception thrown: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 could not be found. Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Request method failure captured: Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 HTTP/1.1 Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85WGqZVCzXYlY6bPkeLabuXvE_lXQugpStd5zK1erBoJz9dMg_9s1yX1fcRpXBey26pBNSVUq4U030u2fdfMBj4DPkUVy4sprIcjmoxEzceGjsZW9cn-83u_Ia-UQJWo4mGpKVTGjDnCVeYdf7B6rSkkv9Fzw8nMSkjZqcOfF8e4U-A Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: e202fe4250104681a9fe73fc4750c33f Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-TestMinimumBasicScenario-2141608139 Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:30:56.590504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e202fe4250104681a9fe73fc4750c33f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e202fe4250104681a9fe73fc4750c33f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e202fe4250104681a9fe73fc4750c33f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e202fe4250104681a9fe73fc4750c33f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-TestMinimumBasicScenario-2141608139 Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: e202fe4250104681a9fe73fc4750c33f Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2141608139 Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-TestMinimumBasicScenario-2141608139-project Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: e49a2b5153b04661b3ef6fe699867005 Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-TestMinimumBasicScenario-2141608139-project Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 could not be found. Aug 10 11:30:56.592229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '34add072-ed4f-4601-b02e-e5b98edbb970'} Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 could not be found. Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:30:56.593050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 could not be found. Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 could not be found. Aug 10 11:30:56.594312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:30:56.595430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Returning 404 to user: Instance 34add072-ed4f-4601-b02e-e5b98edbb970 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:30:56.595430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d7de2545-a2e2-41d9-a41f-0a67c6fb6a13 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970" status: 404 len: 111 microversion: 2.1 time: 0.035043 Aug 10 11:30:56.595430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 484/980] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:30:56 2022] GET /compute/v2.1/servers/34add072-ed4f-4601-b02e-e5b98edbb970 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:30:56.601019 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2b9c0dc5-f87d-49e9-96f6-1bfd2f640516 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] Calling method '.version_select at 0x7f6f4478f700>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:30:56.762776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2b9c0dc5-f87d-49e9-96f6-1bfd2f640516 tempest-TestMinimumBasicScenario-2141608139 tempest-TestMinimumBasicScenario-2141608139-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-257903232" status: 202 len: 0 microversion: 2.1 time: 0.165496 Aug 10 11:30:56.763356 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 497/981] 10.222.0.13 () {58 vars in 1269 bytes} [Wed Aug 10 11:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-257903232 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:30:59.741014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1828961744", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42f526d8-2583-44b1-91be-b1dd0d8b867f"}], "security_groups": [{"name": "tempest-securitygroup--1005057392"}], "key_name": "tempest-keypair-379378277", "user_data": "}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:31:00.114731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] validate_networks() for [('42f526d8-2583-44b1-91be-b1dd0d8b867f', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:31:00.765801 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:31:00.766383 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:31:00.766673 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:31:00.767073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:31:00.767617 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:31:00.776629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:00.777308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:00.777743 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:00.778495 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:00.778925 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:00.779465 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:00.799973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Getting quotas for project 362ec4487088496a8198a3cf71815256. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:31:00.804795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Getting quotas for user 11be37af210c45fc9ddebf7f28b265ef and project 362ec4487088496a8198a3cf71815256. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:31:00.818708 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:31:00.821505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:31:01.046356 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5570d940-317f-4ef7-be39-79192df78048 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.309496 Aug 10 11:31:01.046997 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 485/982] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:30:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:31:01.059094 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-61f60071-dfa7-4f9e-a208-502ed5c03005 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:01.059897 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-61f60071-dfa7-4f9e-a208-502ed5c03005 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:01.141881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-61f60071-dfa7-4f9e-a208-502ed5c03005 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:01.150489 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-61f60071-dfa7-4f9e-a208-502ed5c03005 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1237 microversion: 2.1 time: 0.096009 Aug 10 11:31:01.153517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 498/983] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:01 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:01.961286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:01.961820 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:01.967808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:01.968338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:01.968781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:01.969672 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:01.970138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:01.970566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:01.974764 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:02.058396 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lazy-loading 'services' on Instance uuid 7f999fcc-0926-4db9-9acc-218a002e1ae4 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:31:02.172854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:02.173573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:02.180555 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:02.180980 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:02.181389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:02.184371 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:02.184847 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:02.185287 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:02.252771 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:02.262241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-609ea9d3-6634-43ce-baab-b7bab41c4207 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1241 microversion: 2.1 time: 0.091421 Aug 10 11:31:02.262241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 499/984] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:02 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:02.400431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-830d44e7-c905-4e6f-abe4-dbad911e8527 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments/4452f58f-78a9-4af2-9281-b61ea37bb22d" status: 202 len: 0 microversion: 2.1 time: 0.443698 Aug 10 11:31:02.401022 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 486/985] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:31:01 2022] DELETE /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments/4452f58f-78a9-4af2-9281-b61ea37bb22d => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:31:02.412848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:02.415083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:02.422544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:02.423049 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:02.423575 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:02.424320 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:02.424776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:02.425238 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:02.458056 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-066308a5-81b9-4a0a-858b-ef97bd027e08 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048919 Aug 10 11:31:02.458778 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 500/986] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:31:02 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:31:03.286688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:03.288191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:03.296007 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:03.296598 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:03.297034 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:03.297723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:03.298170 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:03.298650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:03.380655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:03.393122 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4559d21e-9415-4acf-a1f2-aa6b6f054c04 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1233 microversion: 2.1 time: 0.114415 Aug 10 11:31:03.393747 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 487/987] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:03 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1233 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:03.471258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:03.473494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:03.480544 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:03.481042 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:03.481511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:03.482211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:03.482889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:03.483315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:03.515540 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1dfd53f2-d1c5-42bb-9e46-f5a27ee5d1ed tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048676 Aug 10 11:31:03.520578 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 501/988] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:31:03 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:31:04.415934 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:04.416624 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:04.423973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:04.427689 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:04.428341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:04.429266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:04.429892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:04.430330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:04.503886 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:04.511529 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b3d455e4-ae37-4e46-993d-83cd51bd84a1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1297 microversion: 2.1 time: 0.099746 Aug 10 11:31:04.512063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 488/989] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:04 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:04.528118 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:04.530532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:04.537166 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:04.537655 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:04.538104 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:04.538841 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:04.539330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:04.539762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:04.573310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b415a91a-891a-46e7-a347-77dd96f5eae3 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049177 Aug 10 11:31:04.574032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 502/990] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:31:04 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:31:04.662656 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:04.663152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:04.666124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:04.670693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:04.671180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:04.671612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:04.672412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:04.672859 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:04.673284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:04.698868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:31:05.136868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6a807ff1-6efc-4c8b-be4a-6ef2e0506c15 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 204 len: 0 microversion: 2.1 time: 0.477191 Aug 10 11:31:05.137472 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 489/991] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:31:04 2022] DELETE /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:31:05.151348 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:05.151983 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:05.157940 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:05.158434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:05.158899 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:05.159601 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:05.160084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:05.160522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:05.295932 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:05.303842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-843b5f5c-8f86-45ae-b709-41b323c89fbe tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1691 microversion: 2.1 time: 0.156358 Aug 10 11:31:05.304528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 503/992] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:05 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:05.534540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:05.535156 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:05.542719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:05.545802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:05.545802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:05.545802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:05.545802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:05.546188 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:05.608302 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:05.615768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-88f66b7e-9148-437d-892c-4c2f062e4c3d tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1295 microversion: 2.1 time: 0.085634 Aug 10 11:31:05.616377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 490/993] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:05 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:06.325848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:06.326406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:06.333307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:06.333803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:06.334242 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:06.334954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:06.335648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:06.336323 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:06.499170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:06.506623 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d3a7e1d6-6c31-439f-9dfc-6016ad8871b4 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1691 microversion: 2.1 time: 0.184955 Aug 10 11:31:06.507233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 504/994] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:06 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:06.637807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:06.638426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:06.645727 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:06.646221 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:06.646666 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:06.647369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:06.647825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:06.648294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:06.780932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:06.790937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-92ea8978-b20d-4959-a610-3eed23b7149c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.157510 Aug 10 11:31:06.792670 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 491/995] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:06 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:07.529420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:07.530076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:07.537013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:07.537504 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:07.537939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:07.538648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:07.539154 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:07.539515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:07.681837 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:07.691624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-779ea06d-ad54-4e2a-ba65-f3500d53cea8 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1691 microversion: 2.1 time: 0.166334 Aug 10 11:31:07.692247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 505/996] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:07 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:07.814787 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:07.816107 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:07.826484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:07.827263 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:07.827693 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:07.828599 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:07.829340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:07.829926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:08.006522 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:08.015833 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-82fe3e10-8362-4be7-a24e-24aceb7b1111 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.205825 Aug 10 11:31:08.016927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 492/997] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:07 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:08.715008 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:08.715500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:08.722894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:08.723378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:08.723810 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:08.724562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:08.725032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:08.725459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:08.859368 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:08.870346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-75e92829-d4e3-4a66-818a-ce68b9495ade tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1691 microversion: 2.1 time: 0.160670 Aug 10 11:31:08.871265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 506/998] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:08 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:09.037285 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:09.037901 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:09.044559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:09.045044 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:09.045481 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:09.046165 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:09.046616 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:09.047040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:09.180727 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:09.189027 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d525ad68-b47d-44b6-9fa1-baf59fa50f15 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.155605 Aug 10 11:31:09.189843 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 493/999] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:09 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:09.298379 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-3587738a-ffe5-4b0b-a736-2ea6f0c727f4 req-1c29d448-7b49-496e-b31b-f407287cd726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2357eb5b-b599-4cf5-828b-ef2d1ede6e7e", "tag": "d58bfcae-172e-4a2b-8750-77181d0b93c7"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:31:09.309613 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3587738a-ffe5-4b0b-a736-2ea6f0c727f4 req-1c29d448-7b49-496e-b31b-f407287cd726 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:09.310638 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3587738a-ffe5-4b0b-a736-2ea6f0c727f4 req-1c29d448-7b49-496e-b31b-f407287cd726 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:09.311227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3587738a-ffe5-4b0b-a736-2ea6f0c727f4 req-1c29d448-7b49-496e-b31b-f407287cd726 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:09.324258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-3587738a-ffe5-4b0b-a736-2ea6f0c727f4 req-1c29d448-7b49-496e-b31b-f407287cd726 service nova] Creating event network-changed:d58bfcae-172e-4a2b-8750-77181d0b93c7 for instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e on hv-cinder-85061 Aug 10 11:31:09.329487 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-3587738a-ffe5-4b0b-a736-2ea6f0c727f4 req-1c29d448-7b49-496e-b31b-f407287cd726 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039100 Aug 10 11:31:09.330750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 507/1000] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:31:09.894903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:09.894903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:09.899968 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:09.900497 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:09.900927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:09.901803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:09.902251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:09.902679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:09.973355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:09.981818 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-02112691-1f91-4b0b-a7b4-1b15d1190e78 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1623 microversion: 2.1 time: 0.094576 Aug 10 11:31:09.982400 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 494/1001] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:09 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1623 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:10.211932 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:10.213345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:10.220765 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:10.221514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:10.222428 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:10.223174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:10.223658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:10.224109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:10.370400 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:10.379303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5b7319f0-b64d-4dec-84c3-5b3676cf84e1 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.172331 Aug 10 11:31:10.379744 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 508/1002] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:10 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:11.002945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:11.004218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:11.006869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:11.007791 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=6 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:11.013340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:11.013940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:11.014632 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:11.015575 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:11.016135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:11.016823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:11.081937 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:11.091799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b687254d-2fa1-4f49-94c5-a10b3786103d tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1331 microversion: 2.1 time: 0.092780 Aug 10 11:31:11.092405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 495/1003] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:10 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:11.356073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-332aa80c-edbe-42c0-99de-03f25ac1892f req-dcc9fc1b-6bc0-4ffc-a700-84e861709dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f999fcc-0926-4db9-9acc-218a002e1ae4", "name": "network-vif-deleted", "tag": "c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:31:11.368698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=6 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:11.376263 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-332aa80c-edbe-42c0-99de-03f25ac1892f req-dcc9fc1b-6bc0-4ffc-a700-84e861709dc1 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:11.377082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-332aa80c-edbe-42c0-99de-03f25ac1892f req-dcc9fc1b-6bc0-4ffc-a700-84e861709dc1 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:11.377631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-332aa80c-edbe-42c0-99de-03f25ac1892f req-dcc9fc1b-6bc0-4ffc-a700-84e861709dc1 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:11.405340 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:11.406151 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:11.410372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-332aa80c-edbe-42c0-99de-03f25ac1892f req-dcc9fc1b-6bc0-4ffc-a700-84e861709dc1 service nova] Creating event network-vif-deleted:c3fc07d0-269b-42c4-8cbc-58a7d7e77fa5 for instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 on hv-cinder-85061 Aug 10 11:31:11.415687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:11.416744 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:11.417421 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:11.418522 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:11.420077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-332aa80c-edbe-42c0-99de-03f25ac1892f req-dcc9fc1b-6bc0-4ffc-a700-84e861709dc1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068764 Aug 10 11:31:11.420792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:11.421553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 509/1004] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:31:11.426102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:11.576853 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:11.585377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1e1f35f2-f01c-415e-91c7-ddee51135ed2 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.186435 Aug 10 11:31:11.596517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 496/1005] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:11 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:12.114203 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:12.114963 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:12.122424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:12.122910 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:12.123345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:12.124113 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:12.124570 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:12.124993 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:12.190939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:12.198546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cbfe742f-1123-4f56-ab54-0d079ae98712 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1331 microversion: 2.1 time: 0.088578 Aug 10 11:31:12.199104 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 510/1006] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:12 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1331 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:12.607832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:12.608483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:12.614792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:12.615272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:12.615703 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:12.616414 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:12.616863 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:12.617284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:12.750316 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:12.755903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a5248e62-c4ea-4865-858c-bc6f819b026c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.152811 Aug 10 11:31:12.756486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 497/1007] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:12 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:13.219315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:13.219948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:13.226198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:13.226680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:13.227118 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:13.227802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:13.228522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:13.228948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:13.290852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:13.298561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e22b6aa1-c859-403d-b673-bbbc7233bdf5 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 200 len: 1331 microversion: 2.1 time: 0.083216 Aug 10 11:31:13.299126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 511/1008] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:13 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 1331 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:13.777673 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:13.778281 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:13.785122 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:13.786015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:13.786293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:13.787005 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:13.787548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:13.787868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:13.922934 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:13.931911 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0a508255-ae55-48a0-a11b-035944057d02 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.158834 Aug 10 11:31:13.932581 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 498/1009] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:13 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:14.320897 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:14.321684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7f999fcc-0926-4db9-9acc-218a002e1ae4] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:14.328855 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:14.329283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:14.329720 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:14.330414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:14.330869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:14.331295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:14.345592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] HTTP exception thrown: Instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 could not be found. Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Request method failure captured: Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 HTTP/1.1 Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHwu4FUR1_6OifWImd_SAoLvZrJFAvoiHwxJf-Mi0BuQaKZ6BnuSgu648_Z7D4SbmaZtsmt0NYxxeKVeDrQz34LCrsGWwa4sD3bm004i3qaMtU1umyDyLQRBIYUkSx4m7-GrNzpO-X4fjlKSktXQwvPigXNg1NLVD20w2HraTJPXI Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:31:14.348043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 9b5890ee9a114299b0a15a6608503632 Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 could not be found. Aug 10 11:31:14.349548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '7f999fcc-0926-4db9-9acc-218a002e1ae4'} Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 could not be found. Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:31:14.350733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 could not be found. Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 could not be found. Aug 10 11:31:14.352190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:14.353752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Returning 404 to user: Instance 7f999fcc-0926-4db9-9acc-218a002e1ae4 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:31:14.353752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6d51b63d-91d1-4edc-a845-45d33299d5bd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4" status: 404 len: 111 microversion: 2.1 time: 0.032380 Aug 10 11:31:14.353752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 512/1010] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:14 2022] GET /compute/v2.1/servers/7f999fcc-0926-4db9-9acc-218a002e1ae4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:31:14.363016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-46c7541b-ced8-4f42-aeff-dafddef5d8ca tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '.version_select at 0x7f6f44398700>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:14.466326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-46c7541b-ced8-4f42-aeff-dafddef5d8ca tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562072889" status: 202 len: 0 microversion: 2.1 time: 0.107810 Aug 10 11:31:14.466939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 499/1011] 10.222.0.13 () {58 vars in 1221 bytes} [Wed Aug 10 11:31:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562072889 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:31:14.952742 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:14.953770 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:14.960189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:14.960708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:14.961153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:14.961875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:14.962359 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:14.963331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:15.098726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:15.106784 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-57b13237-defc-4126-83d3-5df8c0c2c7a6 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.158020 Aug 10 11:31:15.107337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 513/1012] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:14 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:16.091891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-bd02aa9a-36d8-48f3-981d-ba4500b4c8db req-d1ccde1a-d588-411e-b4a4-3422c7f95f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2357eb5b-b599-4cf5-828b-ef2d1ede6e7e", "name": "network-vif-plugged", "status": "completed", "tag": "d58bfcae-172e-4a2b-8750-77181d0b93c7"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:31:16.102059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-bd02aa9a-36d8-48f3-981d-ba4500b4c8db req-d1ccde1a-d588-411e-b4a4-3422c7f95f47 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:16.102536 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-bd02aa9a-36d8-48f3-981d-ba4500b4c8db req-d1ccde1a-d588-411e-b4a4-3422c7f95f47 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:16.102967 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-bd02aa9a-36d8-48f3-981d-ba4500b4c8db req-d1ccde1a-d588-411e-b4a4-3422c7f95f47 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:16.113907 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-bd02aa9a-36d8-48f3-981d-ba4500b4c8db req-d1ccde1a-d588-411e-b4a4-3422c7f95f47 service nova] Creating event network-vif-plugged:d58bfcae-172e-4a2b-8750-77181d0b93c7 for instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e on hv-cinder-85061 Aug 10 11:31:16.118983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-bd02aa9a-36d8-48f3-981d-ba4500b4c8db req-d1ccde1a-d588-411e-b4a4-3422c7f95f47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031899 Aug 10 11:31:16.119564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 500/1013] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:31:16.128262 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:16.128905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:16.134925 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:16.138557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:16.138557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:16.138557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:16.138557 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:16.138914 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:16.141729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:16.274315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:16.282501 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d3a051b3-d1ab-4ce0-bf0e-3aae3883722e tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.158365 Aug 10 11:31:16.283074 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 514/1014] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:16 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:17.303737 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:17.304391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:17.311198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:17.311681 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:17.312229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:17.314365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:17.314829 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:17.315260 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:17.445309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:17.453188 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8c305e25-da23-4651-89be-ea70fed5cbd5 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.154176 Aug 10 11:31:17.453756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 501/1015] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:17 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:18.013427 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:18.013937 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:18.020334 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:18.020823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:18.021265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:18.021957 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:18.022412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:18.022838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:18.048240 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Going to try to terminate instance {{(pid=118425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:31:18.423840 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ca871cca-dd3a-4a76-bbbf-be4379797dae tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 204 len: 0 microversion: 2.1 time: 0.414436 Aug 10 11:31:18.424474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 515/1016] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:31:18 2022] DELETE /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:31:18.433120 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:18.433713 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:18.440099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:18.440620 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:18.441054 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:18.441739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:18.442192 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:18.442614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:18.446568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:18.474994 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:18.475686 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:18.482401 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:18.482891 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:18.483329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:18.484050 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:18.484506 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:18.484931 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:18.626660 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:18.634138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-22ca4584-4000-488c-97b5-c3dfd56ea86c tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1509 microversion: 2.1 time: 0.205524 Aug 10 11:31:18.634709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 502/1017] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:18 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:18.655199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:18.662745 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2f198fb9-8278-44f4-840d-b9541acac5b7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1363 microversion: 2.1 time: 0.191891 Aug 10 11:31:18.663305 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 516/1018] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:18 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:31:19.656303 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:19.656909 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:19.663627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:19.664143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:19.664575 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:19.665251 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:19.665698 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:19.666115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:19.684563 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:19.685226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:19.691646 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:19.692111 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:19.692547 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:19.693235 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:19.693682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:19.694102 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:20.128087 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:20.129212 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:20.136987 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-65966996-3041-4bd8-bf9c-9e5298fd1152 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1509 microversion: 2.1 time: 0.485874 Aug 10 11:31:20.137568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 503/1019] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:19 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1509 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:20.139506 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-39a16a0a-382d-41d8-af71-279bb7eafc60 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1550 microversion: 2.1 time: 0.459310 Aug 10 11:31:20.140222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 517/1020] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:19 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1550 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:31:20.160415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:20.160941 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:20.166973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:20.172404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:20.172404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:20.172404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:20.172404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:20.172794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:20.246607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1bde16c6-6f60-43cf-8bce-49deaa63e976 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090088 Aug 10 11:31:20.247269 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 504/1021] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 10 11:31:20 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:31:20.462753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-10fbb859-0e59-4688-817e-d5d15ec79eee req-f56858a2-af1a-4f16-bfd7-5f25c541eada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1dee8fd-096f-489c-a67b-dee7491702ad", "name": "network-vif-deleted", "tag": "fbf08147-0d64-437e-af90-de99285a3fd7"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:31:20.472997 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-10fbb859-0e59-4688-817e-d5d15ec79eee req-f56858a2-af1a-4f16-bfd7-5f25c541eada service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:20.474407 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-10fbb859-0e59-4688-817e-d5d15ec79eee req-f56858a2-af1a-4f16-bfd7-5f25c541eada service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:20.474919 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-10fbb859-0e59-4688-817e-d5d15ec79eee req-f56858a2-af1a-4f16-bfd7-5f25c541eada service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:20.488466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-10fbb859-0e59-4688-817e-d5d15ec79eee req-f56858a2-af1a-4f16-bfd7-5f25c541eada service nova] Creating event network-vif-deleted:fbf08147-0d64-437e-af90-de99285a3fd7 for instance e1dee8fd-096f-489c-a67b-dee7491702ad on hv-cinder-85061 Aug 10 11:31:20.499838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-10fbb859-0e59-4688-817e-d5d15ec79eee req-f56858a2-af1a-4f16-bfd7-5f25c541eada service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034143 Aug 10 11:31:20.499838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 518/1022] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:31:21.158821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:21.159430 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:21.165433 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:21.165913 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:21.166352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:21.167036 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:21.167586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:21.168024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:21.200506 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:21.200996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:21.201431 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:21.202012 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lazy-loading 'fault' on Instance uuid e1dee8fd-096f-489c-a67b-dee7491702ad {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:31:21.247159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:21.254773 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ec030705-4006-4a7d-a330-ff0e2473c8e9 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 200 len: 1312 microversion: 2.1 time: 0.100392 Aug 10 11:31:21.255337 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 505/1023] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:21 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:22.278409 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:22.279116 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: e1dee8fd-096f-489c-a67b-dee7491702ad] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:22.281156 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:31:22.286011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:22.286561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:22.287065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:22.287758 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:22.288234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:22.288658 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:22.303059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] HTTP exception thrown: Instance e1dee8fd-096f-489c-a67b-dee7491702ad could not be found. Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Request method failure captured: Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad HTTP/1.1 Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHwu4FUR1_6OifWImd_SAoLvZrJFAvoiHwxJf-Mi0BuQaKZ6BnuSgu648_Z7D4SbmaZtsmt0NYxxeKVeDrQz34LCrsGWwa4sD3bm004i3qaMtU1umyDyLQRBIYUkSx4m7-GrNzpO-X4fjlKSktXQwvPigXNg1NLVD20w2HraTJPXI Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:31:22.304714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 9b5890ee9a114299b0a15a6608503632 Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance e1dee8fd-096f-489c-a67b-dee7491702ad could not be found. Aug 10 11:31:22.306062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'e1dee8fd-096f-489c-a67b-dee7491702ad'} Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1dee8fd-096f-489c-a67b-dee7491702ad could not be found. Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:31:22.306942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1dee8fd-096f-489c-a67b-dee7491702ad could not be found. Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1dee8fd-096f-489c-a67b-dee7491702ad could not be found. Aug 10 11:31:22.308393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:22.309694 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Returning 404 to user: Instance e1dee8fd-096f-489c-a67b-dee7491702ad could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:31:22.309694 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c851e623-6b7f-4d7a-9082-a0d96583106f tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad" status: 404 len: 111 microversion: 2.1 time: 0.033686 Aug 10 11:31:22.310219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 519/1024] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:22 2022] GET /compute/v2.1/servers/e1dee8fd-096f-489c-a67b-dee7491702ad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:31:22.315241 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:22.315723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:22.322551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:22.323425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:22.323580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:22.324261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:22.324716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:22.325137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:22.351076 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:31:22.511331 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-5f7bb18d-f3b6-4e09-9f5f-11c598d7554a req-7b36fb45-1c02-43c8-a56c-b12bbea25658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2357eb5b-b599-4cf5-828b-ef2d1ede6e7e", "tag": "d58bfcae-172e-4a2b-8750-77181d0b93c7"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:31:22.521965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-5f7bb18d-f3b6-4e09-9f5f-11c598d7554a req-7b36fb45-1c02-43c8-a56c-b12bbea25658 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:22.522597 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-5f7bb18d-f3b6-4e09-9f5f-11c598d7554a req-7b36fb45-1c02-43c8-a56c-b12bbea25658 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:22.523148 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-5f7bb18d-f3b6-4e09-9f5f-11c598d7554a req-7b36fb45-1c02-43c8-a56c-b12bbea25658 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:22.536419 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-5f7bb18d-f3b6-4e09-9f5f-11c598d7554a req-7b36fb45-1c02-43c8-a56c-b12bbea25658 service nova] Creating event network-changed:d58bfcae-172e-4a2b-8750-77181d0b93c7 for instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e on hv-cinder-85061 Aug 10 11:31:22.541519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-5f7bb18d-f3b6-4e09-9f5f-11c598d7554a req-7b36fb45-1c02-43c8-a56c-b12bbea25658 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034670 Aug 10 11:31:22.542182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 520/1025] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:31:22.703844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0d1b56ff-788f-40d2-acc0-669d3b4704ab tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 204 len: 0 microversion: 2.1 time: 0.392283 Aug 10 11:31:22.704721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 506/1026] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:31:22 2022] DELETE /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:31:22.714627 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:22.715362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:22.722169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:22.722662 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:22.723104 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:22.723813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:22.724324 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:22.724755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:22.857876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:22.865486 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b30cdf04-fe48-415a-8c6c-a874c5cb41b2 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.155508 Aug 10 11:31:22.866079 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 521/1027] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:22 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:23.888083 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:23.888846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:23.895395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:23.895951 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:23.896494 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:23.897302 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:23.897822 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:23.898315 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:24.048100 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:24.055960 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5af71ed7-3b98-48a8-8f0e-6893491c99cd tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1523 microversion: 2.1 time: 0.172878 Aug 10 11:31:24.056573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 507/1028] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:23 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:24.559854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-ed9ff81f-2831-4f52-b4a5-9191b0e32de9 req-4eb3272c-f415-4761-9243-3cc07a894072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7efa0d4f-5ba3-4b0b-a331-ce5dab394d80", "name": "network-vif-deleted", "tag": "9fb59bc9-c4a4-4e37-b37f-b173da2c56f4"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:31:24.569820 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ed9ff81f-2831-4f52-b4a5-9191b0e32de9 req-4eb3272c-f415-4761-9243-3cc07a894072 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:24.570291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ed9ff81f-2831-4f52-b4a5-9191b0e32de9 req-4eb3272c-f415-4761-9243-3cc07a894072 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:24.570721 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ed9ff81f-2831-4f52-b4a5-9191b0e32de9 req-4eb3272c-f415-4761-9243-3cc07a894072 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:24.582264 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-ed9ff81f-2831-4f52-b4a5-9191b0e32de9 req-4eb3272c-f415-4761-9243-3cc07a894072 service nova] Creating event network-vif-deleted:9fb59bc9-c4a4-4e37-b37f-b173da2c56f4 for instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 on hv-cinder-85061 Aug 10 11:31:24.587224 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-ed9ff81f-2831-4f52-b4a5-9191b0e32de9 req-4eb3272c-f415-4761-9243-3cc07a894072 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032054 Aug 10 11:31:24.587861 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 522/1029] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:31:25.077310 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:25.077922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:25.084588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:25.085070 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:25.085508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:25.086195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:25.086647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:25.087078 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:25.118099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:25.118568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:25.119003 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:25.119448 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lazy-loading 'fault' on Instance uuid 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:31:25.160918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b5890ee9a114299b0a15a6608503632', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526e4ff2ae594d54a53e628df8802a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:31:25.169272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-eaf73177-af1b-4279-a2c4-607548cdd21a tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 200 len: 1312 microversion: 2.1 time: 0.096152 Aug 10 11:31:25.169836 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 508/1030] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:25 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:31:26.192681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:31:26.193370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] [instance: 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:31:26.199439 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:26.199918 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:26.200378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:26.201058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:31:26.201531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:31:26.201928 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:31:26.215273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] HTTP exception thrown: Instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 could not be found. Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Request method failure captured: Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 HTTP/1.1 Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHwu4FUR1_6OifWImd_SAoLvZrJFAvoiHwxJf-Mi0BuQaKZ6BnuSgu648_Z7D4SbmaZtsmt0NYxxeKVeDrQz34LCrsGWwa4sD3bm004i3qaMtU1umyDyLQRBIYUkSx4m7-GrNzpO-X4fjlKSktXQwvPigXNg1NLVD20w2HraTJPXI Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:31:26.216969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_526e4ff2ae594d54a53e628df8802a92"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 526e4ff2ae594d54a53e628df8802a92 Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-808312889 Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 9b5890ee9a114299b0a15a6608503632 Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-ServerRescueNegativeTestJSON-808312889-project Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 could not be found. Aug 10 11:31:26.218357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '7efa0d4f-5ba3-4b0b-a331-ce5dab394d80'} Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 could not be found. Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:31:26.219105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 could not be found. Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 could not be found. Aug 10 11:31:26.220572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:31:26.222034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] Returning 404 to user: Instance 7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:31:26.222034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c0503d29-873a-4579-99e6-e9d1a64f19d7 tempest-ServerRescueNegativeTestJSON-808312889 tempest-ServerRescueNegativeTestJSON-808312889-project] 10.222.0.13 "GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80" status: 404 len: 111 microversion: 2.1 time: 0.030437 Aug 10 11:31:26.222034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 523/1031] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:31:26 2022] GET /compute/v2.1/servers/7efa0d4f-5ba3-4b0b-a331-ce5dab394d80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:32:11.973802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:11.974395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:11.976592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:11.977248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:11.982175 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:11.982658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:11.983094 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:11.983781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:11.984258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:11.989306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:12.009558 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-49dcfb6f-63dc-431f-9869-570f7357a86c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/ips" status: 200 len: 152 microversion: 2.20 time: 0.039890 Aug 10 11:32:12.010125 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 509/1032] 10.222.0.13 () {60 vars in 1289 bytes} [Wed Aug 10 11:32:11 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:32:14.244217 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:14.247542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:14.247542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=9 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:14.247875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:14.251135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-d427f29f-9db2-41ee-b81d-a67fc928aa51 req-e017a642-1307-4b9a-805c-cd54097a753a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97faf99c-8b42-41ba-8242-38a47df81e60", "tag": "8afd3334-557f-4bbd-97db-30863c2d80cc"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:14.253310 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:14.253871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:14.254379 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:14.255150 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:14.255676 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:14.256986 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:14.263364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-d427f29f-9db2-41ee-b81d-a67fc928aa51 req-e017a642-1307-4b9a-805c-cd54097a753a service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:14.263869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-d427f29f-9db2-41ee-b81d-a67fc928aa51 req-e017a642-1307-4b9a-805c-cd54097a753a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:14.264332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-d427f29f-9db2-41ee-b81d-a67fc928aa51 req-e017a642-1307-4b9a-805c-cd54097a753a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:14.276405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-d427f29f-9db2-41ee-b81d-a67fc928aa51 req-e017a642-1307-4b9a-805c-cd54097a753a service nova] Creating event network-changed:8afd3334-557f-4bbd-97db-30863c2d80cc for instance 97faf99c-8b42-41ba-8242-38a47df81e60 on hv-cinder-85061 Aug 10 11:32:14.282695 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-d427f29f-9db2-41ee-b81d-a67fc928aa51 req-e017a642-1307-4b9a-805c-cd54097a753a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035479 Aug 10 11:32:14.285023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 510/1033] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:14.285159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Going to try to terminate instance {{(pid=118425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:32:14.713334 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c4abf8e7-bbd5-470d-ac0e-d0171818b0f8 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "DELETE /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 204 len: 0 microversion: 2.1 time: 0.472973 Aug 10 11:32:14.714695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 524/1034] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:32:14 2022] DELETE /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:32:14.723915 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:14.725299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:14.732274 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:14.732896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:14.733330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:14.734106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:14.734481 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:14.734910 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:14.877163 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:14.884768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c8962e59-0682-4ce4-915c-508eac452217 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.165504 Aug 10 11:32:14.885385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 511/1035] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:14 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:15.592492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:15.593110 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:15.599576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:15.600073 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:15.600505 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:15.601178 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:15.601626 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:15.602044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:15.626587 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lazy-loading 'flavor' on Instance uuid ad2cec8c-8c64-40a9-b670-ad87c1fd610a {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:32:15.907697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:15.908279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:15.915850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:15.927548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:15.927548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:15.927548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:15.927548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:15.927951 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:16.055654 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:16.063868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-575375fc-9afe-4aa4-adc4-71602884c71a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1568 microversion: 2.1 time: 0.160232 Aug 10 11:32:16.064539 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 512/1036] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:15 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:32:16.254649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0ebf7352-581d-41cd-b1ab-1f4cb34a68fc tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/action" status: 202 len: 0 microversion: 2.20 time: 0.666342 Aug 10 11:32:16.255247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 525/1037] 10.222.0.13 () {62 vars in 1319 bytes} [Wed Aug 10 11:32:15 2022] POST /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/action => generated 0 bytes in 668 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:32:16.264284 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:16.264895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:16.270863 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:16.271341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:16.271780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:16.272538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:16.273017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:16.273447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:16.407810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:16.415659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:16.417170 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:16.419344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a8041a21-ea6b-4fc1-9ae9-f99e7a1c9db7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.159737 Aug 10 11:32:16.419923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 513/1038] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:16 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:17.086232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:17.086869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:17.093760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:17.094244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:17.094679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:17.095369 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:17.095820 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:17.096280 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:17.232874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:17.240471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7e9f73b4-3ae7-44a0-98e7-3693fb83e486 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1449 microversion: 2.1 time: 0.159306 Aug 10 11:32:17.241035 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 526/1039] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:17 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1449 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:17.442484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:17.443287 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:17.450828 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:17.451315 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:17.452664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:17.453376 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:17.453830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:17.454255 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:17.506047 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-c8efd9ab-3a00-4b5a-99c8-b716f830d95a req-92494eb6-c672-49e5-bf0e-daf7f83a7770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97faf99c-8b42-41ba-8242-38a47df81e60", "name": "network-vif-deleted", "tag": "8afd3334-557f-4bbd-97db-30863c2d80cc"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:17.515935 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-c8efd9ab-3a00-4b5a-99c8-b716f830d95a req-92494eb6-c672-49e5-bf0e-daf7f83a7770 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:17.516479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-c8efd9ab-3a00-4b5a-99c8-b716f830d95a req-92494eb6-c672-49e5-bf0e-daf7f83a7770 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:17.516905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-c8efd9ab-3a00-4b5a-99c8-b716f830d95a req-92494eb6-c672-49e5-bf0e-daf7f83a7770 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:17.529013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-c8efd9ab-3a00-4b5a-99c8-b716f830d95a req-92494eb6-c672-49e5-bf0e-daf7f83a7770 service nova] Creating event network-vif-deleted:8afd3334-557f-4bbd-97db-30863c2d80cc for instance 97faf99c-8b42-41ba-8242-38a47df81e60 on hv-cinder-85061 Aug 10 11:32:17.533948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-c8efd9ab-3a00-4b5a-99c8-b716f830d95a req-92494eb6-c672-49e5-bf0e-daf7f83a7770 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031542 Aug 10 11:32:17.534695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 527/1040] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:17.595841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:17.603848 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:17.606238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:17.607417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-40c7b342-e191-48cb-8330-cc7a5d03e790 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.168884 Aug 10 11:32:17.607982 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 514/1041] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:17 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:18.263705 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:18.264328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:18.270459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:18.270943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:18.271434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:18.272236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:18.272694 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:18.273123 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:18.334851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46dffe5f71cf4d2ca7bf42f86d2bb07a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e05759c8ab0248e58d35630a611912f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:18.342717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-15fb4ced-5f72-4431-86b3-65339e53561f tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 200 len: 1219 microversion: 2.1 time: 0.084437 Aug 10 11:32:18.343274 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 528/1042] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:18 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:18.629425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:18.630030 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:18.636930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:18.637406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:18.637834 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:18.638509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:18.638957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:18.639372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:18.770424 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:18.778919 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:18.780485 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:18.781619 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a88f8c82-6f78-4464-a3f3-13960b654648 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.156223 Aug 10 11:32:18.782177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 515/1043] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:18 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:19.363760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:19.364943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] [instance: 97faf99c-8b42-41ba-8242-38a47df81e60] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:19.371548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:19.372692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:19.373170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:19.373889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:19.374337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:19.374759 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:19.388538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] HTTP exception thrown: Instance 97faf99c-8b42-41ba-8242-38a47df81e60 could not be found. Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Request method failure captured: Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 HTTP/1.1 Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85V_SA9Gghj4hgoSTeoIn8zdarZkpg_iz1PJTA41PBPaKuQ_Cio5Fz-DAxVbx0hObK4iadzO-neXYeEx8mJBqg3PIGYygXFuU6WiuIgUWfy7fLhF5U0H52ikw6JMzq6wCn7Jh2Qq27CXqfR1dXBNkZG1io4daoLZuY-S2jawWCuT3MM Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: e05759c8ab0248e58d35630a611912f0 Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-TestShelveInstance-1581419066 Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:32:19.390186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e05759c8ab0248e58d35630a611912f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e05759c8ab0248e58d35630a611912f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e05759c8ab0248e58d35630a611912f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e05759c8ab0248e58d35630a611912f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-TestShelveInstance-1581419066 Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: e05759c8ab0248e58d35630a611912f0 Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-TestShelveInstance-1581419066 Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-TestShelveInstance-1581419066-project Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 46dffe5f71cf4d2ca7bf42f86d2bb07a Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-TestShelveInstance-1581419066-project Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 97faf99c-8b42-41ba-8242-38a47df81e60 could not be found. Aug 10 11:32:19.391848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '97faf99c-8b42-41ba-8242-38a47df81e60'} Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97faf99c-8b42-41ba-8242-38a47df81e60 could not be found. Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:19.392832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97faf99c-8b42-41ba-8242-38a47df81e60 could not be found. Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97faf99c-8b42-41ba-8242-38a47df81e60 could not be found. Aug 10 11:32:19.394377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:19.395783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Returning 404 to user: Instance 97faf99c-8b42-41ba-8242-38a47df81e60 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:19.395783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9a71675e-0fae-4bb9-9f87-7b7d375f0d11 tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60" status: 404 len: 111 microversion: 2.1 time: 0.031868 Aug 10 11:32:19.395783 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 529/1044] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:19 2022] GET /compute/v2.1/servers/97faf99c-8b42-41ba-8242-38a47df81e60 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:32:19.666188 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e35c4729-7ff0-450a-8dd3-889b0d9ab08a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] Calling method '.version_select at 0x7f6f441759d0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:19.776726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e35c4729-7ff0-450a-8dd3-889b0d9ab08a tempest-TestShelveInstance-1581419066 tempest-TestShelveInstance-1581419066-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-437234834" status: 202 len: 0 microversion: 2.1 time: 0.114293 Aug 10 11:32:19.777334 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 516/1045] 10.222.0.13 () {58 vars in 1251 bytes} [Wed Aug 10 11:32:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-437234834 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:32:19.804683 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:19.808277 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:19.817016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:19.827449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:19.827449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:19.827449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:19.827449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:19.827834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:19.955856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:19.964209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:19.965825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:19.967083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-839e1476-d565-45d3-92f5-53da6034ea9f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.166519 Aug 10 11:32:19.967814 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 530/1046] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:19 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:20.991378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:20.996291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:20.998796 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:20.999308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:20.999769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:21.000723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:21.001215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:21.001637 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:21.201321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:21.209853 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:21.211509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:21.212869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-cc28eee6-7dd9-4b77-990f-edf7534279d1 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.226199 Aug 10 11:32:21.222834 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 517/1047] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:20 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:22.237376 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:22.250317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:22.250317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:22.250317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:22.250317 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:22.250823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:22.250823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:22.250823 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:22.492553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:22.506488 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:22.507978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:22.509477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-178f3b8f-023f-4496-a0c8-aef189a11896 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.276009 Aug 10 11:32:22.510211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 531/1048] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:22 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:23.335661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:23.336287 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:23.342399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:23.342884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:23.343325 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:23.348499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:23.348499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:23.348499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:23.372566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5abce79b-23b9-4ac5-90ce-ca0fd73a7f5f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/ips" status: 200 len: 150 microversion: 2.1 time: 0.040383 Aug 10 11:32:23.373158 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 518/1049] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:32:23 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:23.533420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:23.534097 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:23.545853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:23.546510 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:23.546952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:23.547668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:23.552541 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:23.553231 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:23.783064 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:23.794357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:23.796631 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:23.798645 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e2fd4b74-7320-4f44-953d-045b5d39ae4a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.269006 Aug 10 11:32:23.799966 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 532/1050] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:23 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:24.828756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:24.829950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:24.838547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:24.839250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:24.839850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:24.841462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:24.842084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:24.842666 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:25.050806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:25.059874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:25.061672 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:25.062827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9d28699f-5206-4f4e-b1e0-70eda90e2ea2 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.240072 Aug 10 11:32:25.063374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 519/1051] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:24 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:26.089852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:26.092701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:26.099457 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:26.101133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:26.101133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:26.101431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:26.102216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:26.102644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:26.311320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1443b98c-7bf0-49e5-af5a-0198a0c8473d"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:26.313761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:26.324841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:26.329872 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:26.329872 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:26.329872 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:26.330482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:26.330923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:26.536094 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:26.545882 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:26.547779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:26.549060 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-eea3f1a9-2c9c-4007-a9df-38f082a0bbb9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.463527 Aug 10 11:32:26.549625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 533/1052] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:26 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:27.380841 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ab1a73ce-e479-440c-a566-738da8c12766 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.074011 Aug 10 11:32:27.385183 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 520/1053] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:32:26 2022] POST /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments => generated 194 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:27.575197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:27.576858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:27.587165 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:27.587781 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:27.588245 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:27.588959 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:27.589484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:27.589953 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:27.938607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:27.948708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:27.951027 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:27.952722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cdfb4851-c618-456d-952c-1162bd9321c4 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.384968 Aug 10 11:32:27.953867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 534/1054] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:27 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:32:28.979296 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:28.980256 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:28.991760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:28.991760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:28.991760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:28.991760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:28.992903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:28.992903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:29.227318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:29.236763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:29.238455 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:29.239601 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-94324cb8-a0ff-4c93-984b-26bc46991999 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1744 microversion: 2.20 time: 0.266495 Aug 10 11:32:29.240342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 521/1055] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:28 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1744 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:30.263178 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:30.268538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:30.271329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:30.272253 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:30.272702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:30.273535 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:30.274043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:30.274479 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:30.420167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:30.428283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:30.434431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:30.434431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7eee9bae-054f-4de7-ab7d-ec108403160f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1744 microversion: 2.20 time: 0.171798 Aug 10 11:32:30.434431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 535/1056] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:30 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:31.455142 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:31.455814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:31.462554 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:31.463042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:31.463482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:31.464224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:31.464682 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:31.465112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:31.595641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:31.603577 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:31.605141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:31.606500 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1a00b343-2ec7-444b-b028-c455fe392d1f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1744 microversion: 2.20 time: 0.155133 Aug 10 11:32:31.607056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 522/1057] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:31 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:32.419724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-af82f495-4496-4bd1-b5db-3e50fb9d3897 req-6a50c63b-0846-448e-9f95-a9f7b2d242b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2cec8c-8c64-40a9-b670-ad87c1fd610a", "name": "network-vif-plugged", "status": "completed", "tag": "bd96a90b-c857-43bf-8f27-2546cc225d06"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:32.429782 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-af82f495-4496-4bd1-b5db-3e50fb9d3897 req-6a50c63b-0846-448e-9f95-a9f7b2d242b0 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:32.430258 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-af82f495-4496-4bd1-b5db-3e50fb9d3897 req-6a50c63b-0846-448e-9f95-a9f7b2d242b0 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:32.430687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-af82f495-4496-4bd1-b5db-3e50fb9d3897 req-6a50c63b-0846-448e-9f95-a9f7b2d242b0 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:32.443067 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-af82f495-4496-4bd1-b5db-3e50fb9d3897 req-6a50c63b-0846-448e-9f95-a9f7b2d242b0 service nova] Creating event network-vif-plugged:bd96a90b-c857-43bf-8f27-2546cc225d06 for instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a on hv-cinder-85061 Aug 10 11:32:32.447938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-af82f495-4496-4bd1-b5db-3e50fb9d3897 req-6a50c63b-0846-448e-9f95-a9f7b2d242b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032468 Aug 10 11:32:32.448564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 536/1058] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:32.630170 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:32.630787 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:32.638238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:32.638538 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:32.638977 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:32.639664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:32.640152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:32.640584 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:32.774468 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:32.782537 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:32.784056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:32.785209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bdfb678b-621f-4673-b7d4-9bf63db19d79 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1744 microversion: 2.20 time: 0.158973 Aug 10 11:32:32.785766 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 523/1059] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:32 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:33.808968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:33.816296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:33.817326 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:33.817813 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:33.818259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:33.818954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:33.819408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:33.819838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:33.955411 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:33.963618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:33.965672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:33.973392 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dbd168a4-25e4-40f4-a1b1-79d2279cb9db tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1744 microversion: 2.20 time: 0.163168 Aug 10 11:32:33.973392 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 537/1060] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:33 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:34.994615 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:34.995248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:35.002100 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:35.002576 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:35.003009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:35.003685 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:35.004163 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:35.004609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:35.142763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:35.151063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:35.163456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:35.163456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-de3b031e-6d5f-40f1-bb61-9bf15a88e6f0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1744 microversion: 2.20 time: 0.163714 Aug 10 11:32:35.163456 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 524/1061] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:34 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:36.115455 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1443b98c-7bf0-49e5-af5a-0198a0c8473d"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:36.120737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:36.124462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:36.124949 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:36.125388 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:36.126105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:36.126584 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:36.127013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:36.177885 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:36.178582 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:36.185719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:36.186199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:36.186650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:36.187339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:36.187780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:36.188252 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:36.205087 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:36.208869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Invalid volume: volume 1443b98c-7bf0-49e5-af5a-0198a0c8473d is already attached to instances: 5007f939-3f30-4d48-b73a-97e538672837 Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: POST /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments HTTP/1.1 Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 74 Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:32:36.210826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {"volumeAttachment": {"volumeId": "1443b98c-7bf0-49e5-af5a-0198a0c8473d"}} Aug 10 11:32:36.212640 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Invalid volume: volume 1443b98c-7bf0-49e5-af5a-0198a0c8473d is already attached to instances: 5007f939-3f30-4d48-b73a-97e538672837 Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'server_id': '5007f939-3f30-4d48-b73a-97e538672837', 'body': {'volumeAttachment': {'volumeId': '1443b98c-7bf0-49e5-af5a-0198a0c8473d'}}} Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1443b98c-7bf0-49e5-af5a-0198a0c8473d is already attached to instances: 5007f939-3f30-4d48-b73a-97e538672837 Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.213905 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1443b98c-7bf0-49e5-af5a-0198a0c8473d is already attached to instances: 5007f939-3f30-4d48-b73a-97e538672837 Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:36.215456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:36.217128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:36.217128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:32:36.217128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:32:36.217128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1443b98c-7bf0-49e5-af5a-0198a0c8473d is already attached to instances: 5007f939-3f30-4d48-b73a-97e538672837 Aug 10 11:32:36.217128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:36.217128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 400 to user: Invalid volume: volume 1443b98c-7bf0-49e5-af5a-0198a0c8473d is already attached to instances: 5007f939-3f30-4d48-b73a-97e538672837 {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:36.217128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5a7ed01f-2686-4fa8-9335-87c826601406 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100936 Aug 10 11:32:36.217128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 538/1062] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:32:36 2022] POST /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:32:36.280249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:36.280749 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:36.287493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:36.287977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:36.288445 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:36.289169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:36.289620 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:36.290043 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:36.326747 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:36.335363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:36.336866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:36.338041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e147ea15-94e9-4eb5-a883-c952f8d8dc8f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1744 microversion: 2.20 time: 0.164186 Aug 10 11:32:36.338597 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 525/1063] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:36 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:36.374137 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'services' on Instance uuid 5007f939-3f30-4d48-b73a-97e538672837 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:32:36.762702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-089bbd6a-b8c9-4564-a992-8298100f491d tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments/1443b98c-7bf0-49e5-af5a-0198a0c8473d" status: 202 len: 0 microversion: 2.1 time: 0.486234 Aug 10 11:32:36.763576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 539/1064] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:32:36 2022] DELETE /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments/1443b98c-7bf0-49e5-af5a-0198a0c8473d => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 11:32:36.773224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:36.775527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:36.791186 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:36.795761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:36.795761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:36.795761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:36.795761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:36.796160 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:36.811581 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:36.823882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7b50330f-f23b-4d99-a4b8-4209b940dad0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054640 Aug 10 11:32:36.824476 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 526/1065] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:32:36 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:32:37.362669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:37.363383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:37.370424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:37.370424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:37.371300 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:37.371645 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:37.372033 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:37.375546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:37.517092 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:37.538746 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:37.540379 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:37.542466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-3a91fa86-f2c8-4171-a84d-dbfc87563627 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.184304 Aug 10 11:32:37.543027 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 540/1066] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:37 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:37.838342 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:37.842146 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:37.849649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:37.850348 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:37.850966 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:37.851844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:37.852320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:37.852745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:37.889674 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5a5b859f-3ac1-4ce0-ab3e-9e25e0116d39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056201 Aug 10 11:32:37.890846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 527/1067] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:32:37 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:38.569064 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:38.570492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:38.577701 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:38.578198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:38.578842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:38.579743 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:38.580387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:38.580972 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:38.730396 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:38.752735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:38.752735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:38.752735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8f27ad62-c622-4ef7-ac58-11d547d87af8 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.177814 Aug 10 11:32:38.753096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 541/1068] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:38 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:38.906435 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:38.909449 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:38.917156 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:38.917978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:38.919230 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:38.920557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:38.921223 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:38.921799 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:38.953335 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-37762ebe-9e3b-4562-9d93-6a8581f1a340 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053111 Aug 10 11:32:38.954028 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 528/1069] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:32:38 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:32:39.028635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:39.029434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:39.036087 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:39.036576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:39.037203 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:39.037904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:39.038379 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:39.038896 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:39.067375 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Going to try to terminate instance {{(pid=118425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:32:39.349157 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:32:39.349446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:32:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 (ip 10.222.0.13) !!! Aug 10 11:32:39.657040 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-179e759d-bafa-4263-a966-f929b3a94493 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 204 len: 0 microversion: 2.1 time: 0.632065 Aug 10 11:32:39.658414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 542/1070] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:32:39 2022] DELETE /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:32:39.666682 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:39.672563 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:39.685344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:39.686180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:39.686633 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:39.687368 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:39.688009 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:39.688579 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:39.771664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:39.773501 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:39.781412 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:39.782349 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:39.783115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:39.784234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:39.785508 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:39.786382 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:39.932982 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:39.944416 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4df8bc71-925c-44a6-893d-595e3675f824 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1681 microversion: 2.1 time: 0.281464 Aug 10 11:32:39.952784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 529/1071] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:39 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1681 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:39.994695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:40.003675 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:40.005298 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:40.006416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ae29f89c-11ef-4dc9-be3b-695bf71c32ac tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.239377 Aug 10 11:32:40.006973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 543/1072] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:39 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:40.965998 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:40.966641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:40.973174 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:40.973653 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:40.974093 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:40.974774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:40.975243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:40.975661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:41.030760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:41.031428 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:41.037863 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:41.038340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:41.038772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:41.039457 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:41.039906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:41.040355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:41.158123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:41.172162 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1c391aaf-552a-4205-9196-e14037356a71 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1681 microversion: 2.1 time: 0.210009 Aug 10 11:32:41.172895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 530/1073] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:40 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:41.197695 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:41.205705 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:41.207209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:41.208394 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cd2dac09-b64d-4610-9b30-36928259376f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.182158 Aug 10 11:32:41.208954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 544/1074] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:41 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:32:42.194679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:42.195578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:42.204108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:42.204803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:42.205417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:42.206198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:42.206873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:42.207518 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:42.232032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:42.233524 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:42.241031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:42.241031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:42.241492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:42.242222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:42.243009 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:42.243857 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:42.476547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:42.491169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e824953c-26b5-43cb-8b1a-26dea3821cd5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1681 microversion: 2.1 time: 0.297629 Aug 10 11:32:42.494954 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 531/1075] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:42 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:42.518517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:42.528227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:42.529953 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:42.531318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a620704b-7431-433e-acf9-d6843a95365f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.304081 Aug 10 11:32:42.532354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 545/1076] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:42 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:32:42.727117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-e987eeff-3186-425d-93cf-60812f48fddd req-8c3e4fc2-7747-444d-a3d7-9a259421ac28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5007f939-3f30-4d48-b73a-97e538672837", "name": "network-vif-deleted", "tag": "daa1370a-f0e8-4ff0-b081-32134fae5ca0"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:42.740934 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-e987eeff-3186-425d-93cf-60812f48fddd req-8c3e4fc2-7747-444d-a3d7-9a259421ac28 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:42.741917 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-e987eeff-3186-425d-93cf-60812f48fddd req-8c3e4fc2-7747-444d-a3d7-9a259421ac28 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:42.742499 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-e987eeff-3186-425d-93cf-60812f48fddd req-8c3e4fc2-7747-444d-a3d7-9a259421ac28 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:42.760576 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-e987eeff-3186-425d-93cf-60812f48fddd req-8c3e4fc2-7747-444d-a3d7-9a259421ac28 service nova] Creating event network-vif-deleted:daa1370a-f0e8-4ff0-b081-32134fae5ca0 for instance 5007f939-3f30-4d48-b73a-97e538672837 on hv-cinder-85061 Aug 10 11:32:42.766544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-e987eeff-3186-425d-93cf-60812f48fddd req-8c3e4fc2-7747-444d-a3d7-9a259421ac28 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043211 Aug 10 11:32:42.769180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 532/1077] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:43.551413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:43.551413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:43.554203 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:43.554706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:43.555136 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:43.556229 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:43.557099 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:43.558108 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:43.558582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:43.559132 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:43.568940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:43.569905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:43.570567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:43.571621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:43.572339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:43.572986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:43.605594 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:43.606134 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:43.606881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:43.608186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'fault' on Instance uuid 5007f939-3f30-4d48-b73a-97e538672837 {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:32:43.678815 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:43.690159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-11cd359c-327a-460a-8194-c2cb531e9418 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 200 len: 1331 microversion: 2.1 time: 0.159244 Aug 10 11:32:43.691020 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 546/1078] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:43 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 1331 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:43.784564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:43.793339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:43.795054 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:43.796252 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2d06cc0e-6c00-4f55-902d-3d5eb5dccf5e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.244748 Aug 10 11:32:43.796816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 533/1079] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:43 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:44.713797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:44.714403 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:44.716821 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:44.721573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:44.722246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:44.722681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:44.723372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:44.723825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:44.724270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:44.738992 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 HTTP/1.1 Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:32:44.741241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:32:44.742845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '5007f939-3f30-4d48-b73a-97e538672837'} Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:32:44.743772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:32:44.745318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:32:44.747340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:32:44.747340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-bc0397ed-dc32-400e-bb2f-d0469e758fe2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 404 len: 111 microversion: 2.1 time: 0.032998 Aug 10 11:32:44.748090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 547/1080] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:44 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:32:44.757258 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-839bd336-a6d0-4f94-ac37-1078d52ef1e3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '.version_select at 0x7f6f4709baf0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:44.893961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-839bd336-a6d0-4f94-ac37-1078d52ef1e3 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112927060" status: 202 len: 0 microversion: 2.1 time: 0.144687 Aug 10 11:32:44.894992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 534/1081] 10.222.0.13 () {58 vars in 1221 bytes} [Wed Aug 10 11:32:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112927060 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:32:45.142635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:45.143581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:45.150262 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:45.151072 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:45.152793 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:45.153842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:45.154492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:45.154938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:45.329328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:45.338477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:45.340803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:45.342248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a3cadae0-ea85-42f9-8144-ecc50bc2e05d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.526053 Aug 10 11:32:45.342812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 548/1082] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:44 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:46.010625 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2741ebe2-4fc7-488a-a66c-1c4c6f334eab tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: .version_select at 0x7f6f44407f70>, body: {"keypair": {"name": "tempest-keypair-334149955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtLdpWcABNChH+mXzi8l2p+juEOHqHfpAapTgvK5EBD1bBzCAnjdRvF+bHDuOMkBZRPg5qsX/6HGEbeGW9/nofb1FTKR12awbgauYRvnwgH2GRGvlKoDdV67FzEbnivlA=="}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:46.017959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:46.028739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-2741ebe2-4fc7-488a-a66c-1c4c6f334eab tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:46.031879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-2741ebe2-4fc7-488a-a66c-1c4c6f334eab tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for user 0782e27e2318438fbf155dfa9cb834b6 and project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'key_pairs'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:46.224385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2741ebe2-4fc7-488a-a66c-1c4c6f334eab tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.218242 Aug 10 11:32:46.225541 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 535/1083] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:32:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:46.367113 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:46.368435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:46.376944 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:46.379590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:46.379590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:46.379590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:46.379590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:46.380448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:46.543822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:46.556233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:46.558228 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:46.560170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-43ff9927-2f64-4931-b75a-11c1ebbce452 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.196942 Aug 10 11:32:46.575812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 549/1084] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:46 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:47.587579 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:47.589032 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:47.598112 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:47.598998 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:47.599677 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:47.601332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:47.602020 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:47.602882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:47.794063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:47.803101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:47.804959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:47.806116 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-98f98eb1-25a9-44ed-bc65-b168cdc89aae tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.224500 Aug 10 11:32:47.806874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 536/1085] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:47 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:48.831434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:48.832276 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:48.841975 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:48.842573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:48.843084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:48.844080 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:48.844760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:48.845265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:49.019785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:49.030270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:49.032020 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:49.033459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b4a5eccc-bc16-405d-832f-c3c72aad7049 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.206539 Aug 10 11:32:49.034170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 550/1086] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:48 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:49.822270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1336195293", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24c11727-9280-4b85-b477-78482251b877"}], "security_groups": [{"name": "tempest-securitygroup--1663325604"}], "key_name": "tempest-keypair-334149955", "user_data": "}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:49.947349 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] validate_networks() for [('24c11727-9280-4b85-b477-78482251b877', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:32:50.060825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:50.062109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:50.074342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:50.075806 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:50.076758 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:50.077710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:50.078404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:50.078920 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:50.370196 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:50.379793 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:50.381330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:50.382566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-740af299-098f-4e64-8f50-d699d0539de6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.328974 Aug 10 11:32:50.383125 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 551/1087] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:50 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:50.495520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:32:50.495980 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:32:50.496544 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:32:50.496961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:32:50.497398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:32:50.506230 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:50.506715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:50.507172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:50.507903 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:50.508397 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:50.508824 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:50.529788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:32:50.530829 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Getting quotas for user 0782e27e2318438fbf155dfa9cb834b6 and project 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:32:50.542032 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:32:50.545081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:32:50.710772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-388d231e-38d3-4a75-a632-611be36f3705 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.892990 Aug 10 11:32:50.712111 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 537/1088] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:32:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:32:50.724355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-094d5164-6ccf-4ed8-8b6d-aadbb65246fe tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:50.725261 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-094d5164-6ccf-4ed8-8b6d-aadbb65246fe tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:50.787787 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-094d5164-6ccf-4ed8-8b6d-aadbb65246fe tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:50.799330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-094d5164-6ccf-4ed8-8b6d-aadbb65246fe tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1241 microversion: 2.1 time: 0.079526 Aug 10 11:32:50.807385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 552/1089] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:50 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:51.274635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:51.275159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:51.282964 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:51.283452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:51.286978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:51.286978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:51.286978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:51.286978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:51.311792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2a6ed17d-7a35-43c7-9c9a-a17572ab343b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/ips" status: 200 len: 147 microversion: 2.1 time: 0.040994 Aug 10 11:32:51.312680 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 538/1090] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:32:51 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:51.405817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:51.406408 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:51.415664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:51.416172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:51.416776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:51.417641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:51.418542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:51.418961 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:51.575934 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:51.584425 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:51.586266 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:51.587425 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-22aa8a53-85ef-4809-803c-879162f6b6ce tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1739 microversion: 2.20 time: 0.186253 Aug 10 11:32:51.587973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 553/1091] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:51 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:51.820920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:51.821607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:51.828665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:51.829150 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:51.829585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:51.830276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:51.830732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:51.831217 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:51.900299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:51.908453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6731950c-994b-4803-baaa-eb83890131d9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1245 microversion: 2.1 time: 0.091495 Aug 10 11:32:51.909021 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 539/1092] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:51 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:52.610759 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:52.612899 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:52.623116 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:52.623885 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:52.624440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:52.625376 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:52.625830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:52.626447 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:52.648794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:52.781496 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:52.789907 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:52.791470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:52.792735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c3163985-eec7-4a4d-bd4e-2eb04920fc82 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1721 microversion: 2.20 time: 0.186569 Aug 10 11:32:52.793348 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 554/1093] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:52 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:52.929572 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:52.930185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:52.937398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:52.937884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:52.938323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:52.939011 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:52.939462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:52.939949 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:53.002221 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:53.012865 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-29b4924d-c7de-4efa-a53a-de1f7c083a23 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1293 microversion: 2.1 time: 0.085822 Aug 10 11:32:53.013688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 540/1094] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:52 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:53.822406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:53.823010 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:53.830959 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:53.831436 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:53.831862 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:53.835951 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:53.835951 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:53.835951 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:53.966319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:53.974435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:53.975911 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:53.977078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fe12d7a1-90ed-4e2e-854e-3b26419bb63b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1721 microversion: 2.20 time: 0.158624 Aug 10 11:32:53.977629 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 555/1095] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:53 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:54.035572 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:54.036218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:54.044173 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:54.045045 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:54.045592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:54.046296 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:54.046750 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:54.047178 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:54.111571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:54.118852 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4815327e-3599-4874-922a-29227eb608f0 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1301 microversion: 2.1 time: 0.088155 Aug 10 11:32:54.119416 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 541/1096] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:54 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:54.294679 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a093a91-3299-4ace-a376-42a97fe1d2c8"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:54.297224 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:54.303049 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:54.303525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:54.303956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:54.304737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:54.305183 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:54.305600 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.000904 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:55.001531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:55.007714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:55.008319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:55.008756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.009445 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:55.009901 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:55.010324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.161280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:55.172450 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:55.173998 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:55.175167 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7b66b1a0-e860-46da-a8a4-6357feb5153e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1721 microversion: 2.20 time: 0.178841 Aug 10 11:32:55.175732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 542/1097] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:54 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 11:32:55.180626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:55.182191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:55.188766 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:55.189198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:55.189637 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.190344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:55.190820 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:55.191250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:55.263210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:55.266053 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-570ca807-1bb9-49d3-a4b5-d584ee7d3e63 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1299 microversion: 2.1 time: 0.089030 Aug 10 11:32:55.266614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 543/1098] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:55 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:55.518248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a4c7c77d-4e22-46af-8ec4-e7e313114738 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.228240 Aug 10 11:32:55.518859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 556/1099] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:32:54 2022] POST /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments => generated 194 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:56.201860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:56.202474 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:56.208886 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.209367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.210063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.210753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.211199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.211621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.289181 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:56.290440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:56.298730 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.299337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.299934 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.300750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.301585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.302250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.367157 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:56.377102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:56.378837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:56.380230 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a43a6125-855e-4ced-96b9-292922ada976 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1664 microversion: 2.20 time: 0.183594 Aug 10 11:32:56.380992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 544/1100] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:32:56 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1664 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:32:56.406835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f38251fa-c599-45f7-8f84-c6b8432ae7cb"}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:56.406835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:56.412126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.412663 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.413095 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.414184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.414814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.415399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.749881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:56.758225 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-51acc591-b7c5-464b-b872-92be7760fefc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.474790 Aug 10 11:32:56.758792 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 557/1101] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:56 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:32:56.764671 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-857da223-efca-40a5-add7-10acff8ae6f8 req-8494ba7b-f735-49da-9d82-6b233e26427a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2cec8c-8c64-40a9-b670-ad87c1fd610a", "name": "network-vif-unplugged", "status": "completed", "tag": "bd96a90b-c857-43bf-8f27-2546cc225d06"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:56.775127 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-857da223-efca-40a5-add7-10acff8ae6f8 req-8494ba7b-f735-49da-9d82-6b233e26427a service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.775576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-857da223-efca-40a5-add7-10acff8ae6f8 req-8494ba7b-f735-49da-9d82-6b233e26427a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.776023 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-857da223-efca-40a5-add7-10acff8ae6f8 req-8494ba7b-f735-49da-9d82-6b233e26427a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.788228 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.compute.server_external_events [req-857da223-efca-40a5-add7-10acff8ae6f8 req-8494ba7b-f735-49da-9d82-6b233e26427a service nova] Unable to find a host for instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a. Dropping event network-vif-unplugged {{(pid=118425) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 11:32:56.789106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-857da223-efca-40a5-add7-10acff8ae6f8 req-8494ba7b-f735-49da-9d82-6b233e26427a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029409 Aug 10 11:32:56.789684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 558/1102] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 11:32:56.794831 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-78187def-f069-419c-b901-52afd7f2d7b3 req-5d484696-a0ec-458c-9147-fc2d58982550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d81c50-faa1-4e54-adee-c8c40b185bce", "tag": "4e984d70-1999-4239-a2e8-3190e84dad77"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:32:56.804420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-78187def-f069-419c-b901-52afd7f2d7b3 req-5d484696-a0ec-458c-9147-fc2d58982550 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:56.805314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-78187def-f069-419c-b901-52afd7f2d7b3 req-5d484696-a0ec-458c-9147-fc2d58982550 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:56.805314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-78187def-f069-419c-b901-52afd7f2d7b3 req-5d484696-a0ec-458c-9147-fc2d58982550 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:56.816633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-78187def-f069-419c-b901-52afd7f2d7b3 req-5d484696-a0ec-458c-9147-fc2d58982550 service nova] Creating event network-changed:4e984d70-1999-4239-a2e8-3190e84dad77 for instance e7d81c50-faa1-4e54-adee-c8c40b185bce on hv-cinder-85061 Aug 10 11:32:56.821362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-78187def-f069-419c-b901-52afd7f2d7b3 req-5d484696-a0ec-458c-9147-fc2d58982550 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Aug 10 11:32:56.821942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 559/1103] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:32:57.211365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:32:57.701657 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0cf4e9a0-a123-4312-8197-68d072853a1a tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.302588 Aug 10 11:32:57.702406 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 545/1104] 10.222.0.13 () {62 vars in 1364 bytes} [Wed Aug 10 11:32:56 2022] POST /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/os-volume_attachments => generated 188 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 11:32:57.781239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:57.781958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:57.788246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:57.788723 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:57.789153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:57.789839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:57.790290 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:57.790715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:57.835329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:57.836017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:57.842507 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:57.843069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:57.843574 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:57.844366 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:57.844886 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:57.845377 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:57.927676 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:57.936114 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1cca3395-91f3-4c82-9943-fc1889cafd0c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.159748 Aug 10 11:32:57.940147 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 560/1105] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:57 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:32:58.957475 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:32:58.958122 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:32:58.964752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.965387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.965709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:58.966393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:32:58.966892 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:32:58.967263 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:32:59.097762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:32:59.105093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ef736609-c86b-4124-b1c3-59f9110964a2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.151478 Aug 10 11:32:59.106281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 561/1106] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:32:58 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:00.126994 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:00.127732 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:00.135026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:00.135508 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:00.135941 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:00.136667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:00.137349 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:00.137752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:00.266562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:00.274064 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-64584f2e-21e8-4f8e-a53a-aafaa2c742a7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.150948 Aug 10 11:33:00.274621 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 562/1107] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:00 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:00.515495 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:00.538039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=10 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:00.552480 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c25ac4fe-1da2-44e2-9e93-e896af69da13 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/os-volume_attachments/f38251fa-c599-45f7-8f84-c6b8432ae7cb" status: 202 len: 0 microversion: 2.20 time: 2.721495 Aug 10 11:33:00.553111 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 546/1108] 10.222.0.13 () {60 vars in 1457 bytes} [Wed Aug 10 11:32:57 2022] DELETE /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/os-volume_attachments/f38251fa-c599-45f7-8f84-c6b8432ae7cb => generated 0 bytes in 2723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:33:00.613822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:00.614414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:00.621012 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:00.622694 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:00.623140 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:00.623832 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:00.624311 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:00.624738 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:00.666757 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118425) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 10 11:33:00.796867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:01.132299 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-784be14b-37f3-4e57-ae77-a963b5e9dc93 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "POST /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/action" status: 202 len: 0 microversion: 2.20 time: 0.522289 Aug 10 11:33:01.133253 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 563/1109] 10.222.0.13 () {62 vars in 1319 bytes} [Wed Aug 10 11:33:00 2022] POST /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:33:01.141783 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:01.142478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:01.149878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.150436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.150929 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.151649 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.152154 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.152563 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.284087 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:01.292098 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:01.294961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:01.296170 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c0311e18-93b1-438d-ae98-1f998e29b2c9 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1672 microversion: 2.20 time: 0.158340 Aug 10 11:33:01.310695 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 547/1110] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:01 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:01.310852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:01.310852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:01.310852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.310852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.311236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.311236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:01.311236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:01.311236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:01.450761 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:01.458111 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-05fe3d53-82f0-468f-8c6e-2e54cf5e8d37 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.165685 Aug 10 11:33:01.458894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 564/1111] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:01 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:02.320526 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:02.321135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:02.328453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:02.329220 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:02.329664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.330418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:02.330877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:02.331390 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.470900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.479402 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.481137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.481662 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:02.482305 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9bf68845-cda1-4204-bbe5-16b9b156c60f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1672 microversion: 2.20 time: 0.165736 Aug 10 11:33:02.482419 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:02.482866 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 548/1112] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:02 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:02.488737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:02.489216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:02.489648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.490332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:02.490870 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:02.491269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:02.627904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:02.635648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2002ef42-2b9f-4d15-b9b1-73757f5d546a tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.158903 Aug 10 11:33:02.636370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 565/1113] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:02 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:03.506002 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:03.506516 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:03.513722 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:03.514201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:03.514635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:03.515384 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:03.515837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:03.516281 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:03.649853 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:03.656664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:03.657273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:03.658385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:03.660055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:03.661294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3a5d4d9c-75c2-4f93-846e-a07a2390e46d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1672 microversion: 2.20 time: 0.159474 Aug 10 11:33:03.661924 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 549/1114] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:03 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:03.663630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:03.664148 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:03.664784 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:03.665482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:03.666233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:03.666663 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:03.806649 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:03.815224 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fd5f9a59-5a96-4239-bb20-db57ee459019 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.162313 Aug 10 11:33:03.815786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 566/1115] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:03 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:04.687177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:04.687800 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:04.694424 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:04.694917 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:04.695380 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:04.696130 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:04.696587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:04.697073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:04.835897 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:04.837280 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:04.837810 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:04.844533 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:04.844994 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:04.845424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:04.845893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:04.846143 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:04.846613 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:04.847018 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:04.848036 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:04.849324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-95e0564a-094a-4cdd-8dcb-ed4171c9065b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.167922 Aug 10 11:33:04.852782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 550/1116] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:04 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:04.990059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:04.997762 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-898cab28-bb55-45dc-8101-631ed386b0e9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.165171 Aug 10 11:33:04.998330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 567/1117] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:04 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:05.873395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:05.874004 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:05.880460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:05.881014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:05.881527 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:05.882279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:05.882802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:05.883312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:06.030417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:06.036748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:06.038472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:06.045322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:06.046081 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:06.046833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:06.047867 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:06.048746 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:06.049478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:06.049750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:06.050997 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:06.060635 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-79a44b1e-1f51-4419-8bbd-6a7ee9db8577 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.191198 Aug 10 11:33:06.064579 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 551/1118] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:05 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:06.271793 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:06.280330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f82de29d-1ccd-4650-8af4-5d0a894093c7 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.264954 Aug 10 11:33:06.281991 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 568/1119] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:06 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:06.660338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-1869eb1d-aa7d-4e3f-92fb-df07c505b82b req-3cfd3f3f-a59e-4fe9-9ace-941b0fc67bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d81c50-faa1-4e54-adee-c8c40b185bce", "name": "network-vif-plugged", "status": "completed", "tag": "4e984d70-1999-4239-a2e8-3190e84dad77"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:06.685014 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-1869eb1d-aa7d-4e3f-92fb-df07c505b82b req-3cfd3f3f-a59e-4fe9-9ace-941b0fc67bf7 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:06.685704 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-1869eb1d-aa7d-4e3f-92fb-df07c505b82b req-3cfd3f3f-a59e-4fe9-9ace-941b0fc67bf7 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:06.686472 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-1869eb1d-aa7d-4e3f-92fb-df07c505b82b req-3cfd3f3f-a59e-4fe9-9ace-941b0fc67bf7 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:06.707343 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-1869eb1d-aa7d-4e3f-92fb-df07c505b82b req-3cfd3f3f-a59e-4fe9-9ace-941b0fc67bf7 service nova] Creating event network-vif-plugged:4e984d70-1999-4239-a2e8-3190e84dad77 for instance e7d81c50-faa1-4e54-adee-c8c40b185bce on hv-cinder-85061 Aug 10 11:33:06.713627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-1869eb1d-aa7d-4e3f-92fb-df07c505b82b req-3cfd3f3f-a59e-4fe9-9ace-941b0fc67bf7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058273 Aug 10 11:33:06.714522 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 552/1120] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:07.088382 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:07.088985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:07.096509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:07.096994 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:07.097421 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:07.098446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:07.099273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:07.099858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:07.247465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.268927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.270803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.272256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-45dbc2f4-036e-409a-9d0b-ca643ce69b6d tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.188175 Aug 10 11:33:07.275717 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 569/1121] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:07 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:07.303757 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:07.305218 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:07.313675 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:07.314296 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:07.314780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:07.315560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:07.316323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:07.316775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:07.466785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:07.476335 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8a55adb4-70ab-4014-8fef-df9ff0ea1572 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.177547 Aug 10 11:33:07.482847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 553/1122] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:07 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:08.299285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:08.300416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:08.308378 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.309420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.309851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.310733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.311377 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.311772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.330570 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:08.485665 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:08.494630 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:08.496471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:08.497652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ae2b7382-c57c-4a81-80b0-c906eb90259b tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.202662 Aug 10 11:33:08.498200 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 570/1123] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:08 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:08.512215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:08.512215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:08.512215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.512215 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.513391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.513391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:08.513391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:08.513391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:08.650644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:08.661242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c6e3a7c0-dabf-4177-a0b8-471039c11fbd tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.165861 Aug 10 11:33:08.662130 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 554/1124] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:08 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:09.520546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:09.526021 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:09.534845 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:09.535509 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:09.536135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:09.536846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:09.537298 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:09.537724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:09.685493 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:09.687300 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:09.695124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:09.696246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:09.696835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:09.697722 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:09.698175 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:09.698597 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:09.714153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.724107 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.728180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.728180 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-bd5e3d08-02b3-420a-a18d-9f260530daf6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.210471 Aug 10 11:33:09.732700 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 571/1125] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:09 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:09.869803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:09.877510 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-af243ba4-0b5c-4ada-ac26-67751c21ca01 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.198454 Aug 10 11:33:09.878141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 555/1126] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:09 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:10.750212 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:10.750830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:10.757916 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.758347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.758785 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.759485 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.759942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.760397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.898976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:10.900661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:10.909311 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.910485 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.911315 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.912335 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:10.912996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:10.913676 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:10.928566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:10.938218 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:10.945039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:10.946566 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-720120b6-8b2c-4c48-96d3-f183756a8350 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.200985 Aug 10 11:33:10.962229 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 572/1127] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:10 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:11.105770 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:11.113547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a9f36d9c-6837-4d7f-81ee-7d7e82fa0e73 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.218606 Aug 10 11:33:11.114119 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 556/1128] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:10 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:11.970875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:11.972248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:11.978355 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:11.979165 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:11.979655 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:11.981003 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:11.981808 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:11.982433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.127011 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.135386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:12.136096 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.136658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:12.138123 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.139484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ee208b6f-9227-4903-9f3b-66aed3fe7ca7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.172558 Aug 10 11:33:12.140319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 573/1129] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:11 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:12.143187 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.143669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.144181 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.144879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:12.145441 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:12.145864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:12.305037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:12.313261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f66322f3-c918-4357-938c-3835a04338a9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.182481 Aug 10 11:33:12.326898 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 557/1130] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:12 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:13.162480 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:13.163076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:13.170443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.170913 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.171528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.172241 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.172688 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.173108 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.319322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.329119 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.332595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.334029 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-95f30603-f019-4293-9c30-4309e0143328 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.175374 Aug 10 11:33:13.334585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 574/1131] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:13 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:13.336501 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:13.337669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:13.351543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.352081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.352526 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.353246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:13.353699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:13.354126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:13.492926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:13.500482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-316176f9-5e19-4a8c-a2b3-010d54a21994 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.168214 Aug 10 11:33:13.501058 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 558/1132] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:13 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:14.358692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:14.359449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:14.365980 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.366808 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.367434 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.368201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.368660 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.372950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.517402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.525017 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:14.526768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:14.526895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.527987 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.529617 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-65c4736e-b0d7-4812-95f3-48ba820d2d60 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.174733 Aug 10 11:33:14.544116 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 575/1133] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:14 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:14.544360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.544360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.544360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.544360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:14.544743 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:14.544743 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:14.552647 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=89,nova_cell1:UPDATE=7 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:14.690270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:14.707084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1b550a2f-1821-4527-804b-cf78b7853f39 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.185756 Aug 10 11:33:14.708075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 559/1134] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:14 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:15.552865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:15.553538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:15.555803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:15.561135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.561617 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.562051 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.562760 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.563211 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.563636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.698484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.706849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.708361 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.709505 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c3051fb6-fac0-4446-aaed-2c2fcb814be7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.160632 Aug 10 11:33:15.710301 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 576/1135] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:15 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:15.729600 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:15.730732 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:15.737319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.737793 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.738225 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.738895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:15.739424 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:15.739844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:15.878547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:15.886329 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d090a125-55b4-4987-ad3c-c6c7f9488103 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.160854 Aug 10 11:33:15.887224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 560/1136] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:15 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:16.733149 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:16.733849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:16.740632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.744681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.744681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.744681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.744681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.745182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.876443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:16.884338 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:16.885830 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:16.887260 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-087bd177-373b-468e-bc6f-3ef37886e6b7 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.159315 Aug 10 11:33:16.887824 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 577/1137] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:16 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:16.908050 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:16.908671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:16.915101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.915587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.916060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:16.916772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:16.917224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:16.917731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:17.049040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:17.056494 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-54e948bc-45f3-46d7-9520-b1ecf0130315 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.152339 Aug 10 11:33:17.057053 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 561/1138] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:16 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:17.910519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:17.911128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:17.918106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:17.918770 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:17.919249 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:17.919968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:17.920430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:17.920939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.063022 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.071020 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.072589 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.074036 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ce466e0a-0b85-4e43-b3d9-9ee871c87062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.167512 Aug 10 11:33:18.074603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 578/1139] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:17 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:18.079179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:18.079882 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:18.086618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:18.087105 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:18.087551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.088264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:18.088720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:18.089148 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:18.224191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:18.238683 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8fb1045a-75dc-4669-b541-c7f3dab97322 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.158397 Aug 10 11:33:18.238683 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 562/1140] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:18 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:19.097264 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:19.097967 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:19.104536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.105104 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.106184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.106935 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.107346 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.107773 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.243098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.252275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.253153 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:19.253788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:19.253904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.255626 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-29e777ac-8d0f-4685-a0fa-bbc0f5c83062 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.161641 Aug 10 11:33:19.255626 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 579/1141] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:19 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:19.260134 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.260672 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.261113 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.262614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:19.263240 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:19.263614 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:19.397388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:19.405615 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6703ea36-8150-43af-b2dc-fe6bcec30e44 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.156296 Aug 10 11:33:19.406198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 563/1142] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:19 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:33:20.278843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:20.279452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:20.285821 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.286295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.286735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.287454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.287909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.289121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.420782 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.444072 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:20.444522 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.444634 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:20.444731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.444731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dbee9ff2-519a-4152-bb94-4ec56d7cee6c tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.158255 Aug 10 11:33:20.444731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 580/1143] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:20 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:20.444986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:20.444986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.444986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.444986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.445350 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:20.445350 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:20.445350 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:20.599462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:20.607739 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a7ab3962-e4f6-4892-ade4-858053e5d695 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.182845 Aug 10 11:33:20.608629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 564/1144] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:20 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:21.259004 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:21.262033 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:21.267801 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.268417 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.268849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.269567 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.270012 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.270471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.298721 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5929ea45-13d5-48f9-a711-78740435e167 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043613 Aug 10 11:33:21.299350 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 581/1145] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:33:21 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:21.310879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:21.311370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:21.317789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.318264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.318694 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.319367 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.319811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.320259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.349332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5c64ca8a-c309-4b93-9b33-1cfac0f31e70 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/5a093a91-3299-4ace-a376-42a97fe1d2c8" status: 200 len: 194 microversion: 2.1 time: 0.043166 Aug 10 11:33:21.349914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 565/1146] 10.222.0.13 () {58 vars in 1413 bytes} [Wed Aug 10 11:33:21 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/5a093a91-3299-4ace-a376-42a97fe1d2c8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:21.466164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:21.466771 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:21.472843 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.473332 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.473748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.474633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.475110 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.475532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.613252 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:21.622628 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:21.624153 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:21.625314 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6c20151c-e4ac-42d4-b420-9c1482634f01 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.163217 Aug 10 11:33:21.625871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 582/1147] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:21 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:21.630573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:21.631194 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:21.638464 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.638952 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.639417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.640282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:21.640736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:21.641159 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:21.773767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:21.781474 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-400953e9-2aee-47e3-b935-52376eb92521 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1367 microversion: 2.1 time: 0.156301 Aug 10 11:33:21.782044 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 566/1148] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:21 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:22.647676 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:22.648364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:22.654976 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.655465 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.655902 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.656634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.657091 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.657515 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.799779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.802815 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:22.803566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:22.808257 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.809900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.811106 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.811403 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f920a80a-2e73-4c8c-97ed-e62b65dd6600 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.167566 Aug 10 11:33:22.811861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.812145 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 583/1149] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:22 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:22.812330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.813298 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.813830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.814413 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.949490 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:22.957077 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6b038748-220f-4a11-b817-22ce526ef856 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1557 microversion: 2.1 time: 0.158060 Aug 10 11:33:22.957643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 567/1150] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:22 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:22.978641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:22.979138 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:22.985906 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.986393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.986836 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:22.987531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:22.988014 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:22.988432 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.077208 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5964e921-1201-4fe5-b629-d69f88dc42f2 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102396 Aug 10 11:33:23.077798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 584/1151] 10.222.0.13 () {58 vars in 1275 bytes} [Wed Aug 10 11:33:22 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:23.839306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:23.839306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:23.848199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.848705 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.849141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.849851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:23.850297 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:23.850835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:23.997292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:24.008187 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:24.010320 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:24.011558 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-936118c0-0377-4776-a024-2922d3598fe6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.180756 Aug 10 11:33:24.024401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 568/1152] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:23 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:24.194426 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36f44bd3-8d18-4bb7-89e2-b3d3cdd58f1b"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:24.197440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:24.204678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.205927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.206550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.209345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.209988 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.212296 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.216439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-e4c51875-1265-4a14-969d-c6bbb40b312b req-8ce6a6ff-1379-4769-b442-5b0d4fd9da4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d81c50-faa1-4e54-adee-c8c40b185bce", "tag": "4e984d70-1999-4239-a2e8-3190e84dad77"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:24.226769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-e4c51875-1265-4a14-969d-c6bbb40b312b req-8ce6a6ff-1379-4769-b442-5b0d4fd9da4b service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.227502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-e4c51875-1265-4a14-969d-c6bbb40b312b req-8ce6a6ff-1379-4769-b442-5b0d4fd9da4b service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.228186 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-e4c51875-1265-4a14-969d-c6bbb40b312b req-8ce6a6ff-1379-4769-b442-5b0d4fd9da4b service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.241482 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-e4c51875-1265-4a14-969d-c6bbb40b312b req-8ce6a6ff-1379-4769-b442-5b0d4fd9da4b service nova] Creating event network-changed:4e984d70-1999-4239-a2e8-3190e84dad77 for instance e7d81c50-faa1-4e54-adee-c8c40b185bce on hv-cinder-85061 Aug 10 11:33:24.249176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-e4c51875-1265-4a14-969d-c6bbb40b312b req-8ce6a6ff-1379-4769-b442-5b0d4fd9da4b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037054 Aug 10 11:33:24.251678 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 569/1153] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:33:24.817007 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-0b51412e-7df5-41e3-b2b9-65c96c0b4037 req-15464e50-e8a8-4d36-af00-2cb66a345233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2cec8c-8c64-40a9-b670-ad87c1fd610a", "name": "network-vif-plugged", "status": "completed", "tag": "bd96a90b-c857-43bf-8f27-2546cc225d06"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:24.828546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0b51412e-7df5-41e3-b2b9-65c96c0b4037 req-15464e50-e8a8-4d36-af00-2cb66a345233 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:24.829437 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0b51412e-7df5-41e3-b2b9-65c96c0b4037 req-15464e50-e8a8-4d36-af00-2cb66a345233 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:24.830425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0b51412e-7df5-41e3-b2b9-65c96c0b4037 req-15464e50-e8a8-4d36-af00-2cb66a345233 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:24.843808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-0b51412e-7df5-41e3-b2b9-65c96c0b4037 req-15464e50-e8a8-4d36-af00-2cb66a345233 service nova] Creating event network-vif-plugged:bd96a90b-c857-43bf-8f27-2546cc225d06 for instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a on hv-cinder-85061 Aug 10 11:33:24.851492 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-0b51412e-7df5-41e3-b2b9-65c96c0b4037 req-15464e50-e8a8-4d36-af00-2cb66a345233 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040283 Aug 10 11:33:24.852617 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 570/1154] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:33:25.035303 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:25.042120 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:25.043715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:25.044417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:25.045020 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.045893 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:25.046517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:25.047104 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:25.167009 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:25.244209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.255535 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.257735 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:25.259333 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f10b4500-1cd4-44ba-b771-f8bea93ee749 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.228543 Aug 10 11:33:25.260629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 571/1155] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:25 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:25.301989 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-082202d2-059f-486e-b16d-859b0d64e0e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "POST /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111117 Aug 10 11:33:25.303116 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 585/1156] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:33:24 2022] POST /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments => generated 194 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:26.284632 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:26.285346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:26.292093 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.293309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.294330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.295385 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:26.295939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:26.296755 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:26.474244 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:26.484338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:26.485830 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:26.489101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c2ebb38e-ddf4-4a52-bbe7-e4914f4a7953 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.206444 Aug 10 11:33:26.489101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 572/1157] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:26 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:27.511274 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:27.512244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:27.519689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:27.523985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:27.523985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:27.523985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:27.523985 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:27.524944 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:27.666255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:27.675681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:27.677209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:27.678364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-68dc5804-3acf-47c5-a46f-94f42d93396f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1730 microversion: 2.20 time: 0.171472 Aug 10 11:33:27.679089 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 586/1158] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:27 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:28.705814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:28.706419 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:28.713459 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.713935 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.714418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.715123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:28.715593 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:28.716037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:28.849550 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:28.858774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:28.862090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:28.862090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-03319999-1d86-4513-b743-b02ded4fba96 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1717 microversion: 2.20 time: 0.159574 Aug 10 11:33:28.862090 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 573/1159] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:33:28 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:33:34.988481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:34.990862 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:34.997528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:34.998081 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:34.998526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:34.999209 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:34.999666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:35.000122 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:35.029550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-14513088-c22c-4076-8fcb-aaacf1e44f6b tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044933 Aug 10 11:33:35.030100 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 587/1160] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:33:34 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:35.166646 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:35.167130 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:35.174288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:35.174767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:35.175198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:35.175880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:35.176347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:35.176843 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:35.207332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4885d7c5-ab75-4625-8ed8-026c2cb15e73 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/5a093a91-3299-4ace-a376-42a97fe1d2c8" status: 200 len: 194 microversion: 2.1 time: 0.044473 Aug 10 11:33:35.209190 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 574/1161] 10.222.0.13 () {58 vars in 1413 bytes} [Wed Aug 10 11:33:35 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/5a093a91-3299-4ace-a376-42a97fe1d2c8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:35.220402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:35.220969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:35.227016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:35.227577 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:35.228121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:35.228880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:35.229406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:35.230040 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:35.315817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lazy-loading 'services' on Instance uuid 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:33:35.530055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1401235b-294e-4116-a24f-557fd60bbdf0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/5a093a91-3299-4ace-a376-42a97fe1d2c8" status: 202 len: 0 microversion: 2.1 time: 0.314538 Aug 10 11:33:35.530724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 588/1162] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:33:35 2022] DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/5a093a91-3299-4ace-a376-42a97fe1d2c8 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:33:37.707821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:37.708358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:37.715724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:37.716242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:37.716697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:37.717381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:37.717832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:37.718256 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:37.748348 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1f573d99-84df-4f67-9928-2b9adbee1e85 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/36f44bd3-8d18-4bb7-89e2-b3d3cdd58f1b" status: 200 len: 194 microversion: 2.1 time: 0.044529 Aug 10 11:33:37.748940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 575/1163] 10.222.0.13 () {58 vars in 1413 bytes} [Wed Aug 10 11:33:37 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/36f44bd3-8d18-4bb7-89e2-b3d3cdd58f1b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:37.760610 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:37.761217 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:37.767309 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:37.767794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:37.772164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:37.772164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:37.772164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:37.772164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:37.856190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lazy-loading 'services' on Instance uuid 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:33:38.094657 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-770c7499-4981-47d4-bf94-5cc18de6e04c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/36f44bd3-8d18-4bb7-89e2-b3d3cdd58f1b" status: 202 len: 0 microversion: 2.1 time: 0.338739 Aug 10 11:33:38.095280 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 589/1164] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:33:37 2022] DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments/36f44bd3-8d18-4bb7-89e2-b3d3cdd58f1b => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:33:40.324601 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:40.326806 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:40.333478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.333960 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.334396 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.335085 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.335805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.336261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.367932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d9488cdc-b3b4-45e7-9f0a-a065cba76393 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048157 Aug 10 11:33:40.370021 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 576/1165] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:33:40 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:33:40.486282 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:40.488647 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:40.494553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.495029 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.496163 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.497295 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.497775 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.498212 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.527599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-61624aba-4f6c-4bd8-ab7a-35afba8dbec0 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045939 Aug 10 11:33:40.528187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 590/1166] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:33:40 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:33:40.591502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:40.592013 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:40.597869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.598344 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.598777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.599462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.599921 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.600355 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.602936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=100 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:40.626930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:33:40.912607 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5031a12d-a1c3-4a36-8565-b8f40c162b9c tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 204 len: 0 microversion: 2.1 time: 0.325098 Aug 10 11:33:40.913194 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 577/1167] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:33:40 2022] DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:33:40.922182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:40.923500 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:40.928866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.929340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.929771 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:40.930443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:40.930930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:40.931351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:41.066672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:41.075433 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-919c0ce2-5396-4470-88a6-0554efa20475 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1675 microversion: 2.1 time: 0.157845 Aug 10 11:33:41.076019 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 591/1168] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:40 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:42.098587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:42.099248 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:42.106308 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:42.106782 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:42.107210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:42.107902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:42.108376 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:42.108847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:42.294525 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:42.302277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d2af439d-ed6f-41df-bcfc-e209480aa9e8 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1675 microversion: 2.1 time: 0.208089 Aug 10 11:33:42.302855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 578/1169] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:42 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:43.322968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:43.323572 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:43.330789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:43.331275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:43.331706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:43.332435 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:43.332887 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:43.333306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:43.470661 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:43.478340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ed3ab74a-3ced-4204-8b45-cb778d2936fa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1675 microversion: 2.1 time: 0.159201 Aug 10 11:33:43.478918 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 592/1170] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:43 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:44.202387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-39a98214-39fb-4d58-8178-a329d8871b89 req-5032c4d5-ce85-4188-87fb-2bc8b06e3f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2357eb5b-b599-4cf5-828b-ef2d1ede6e7e", "name": "network-vif-deleted", "tag": "d58bfcae-172e-4a2b-8750-77181d0b93c7"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:33:44.212962 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-39a98214-39fb-4d58-8178-a329d8871b89 req-5032c4d5-ce85-4188-87fb-2bc8b06e3f91 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:44.213485 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-39a98214-39fb-4d58-8178-a329d8871b89 req-5032c4d5-ce85-4188-87fb-2bc8b06e3f91 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:44.213924 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-39a98214-39fb-4d58-8178-a329d8871b89 req-5032c4d5-ce85-4188-87fb-2bc8b06e3f91 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:44.225327 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-39a98214-39fb-4d58-8178-a329d8871b89 req-5032c4d5-ce85-4188-87fb-2bc8b06e3f91 service nova] Creating event network-vif-deleted:d58bfcae-172e-4a2b-8750-77181d0b93c7 for instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e on hv-cinder-85061 Aug 10 11:33:44.231429 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-39a98214-39fb-4d58-8178-a329d8871b89 req-5032c4d5-ce85-4188-87fb-2bc8b06e3f91 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Aug 10 11:33:44.232006 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 579/1171] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:33:44.499895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:44.500535 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:44.507087 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:44.507513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:44.507950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:44.508668 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:44.509123 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:44.509545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:44.573207 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11be37af210c45fc9ddebf7f28b265ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362ec4487088496a8198a3cf71815256', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:33:44.581624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a967f28f-5d97-4049-a927-83764d345154 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 200 len: 1322 microversion: 2.1 time: 0.085414 Aug 10 11:33:44.582450 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 593/1172] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:44 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 1322 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:33:45.694289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:45.694289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:45.694289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:45.694289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:45.695318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:45.695318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:45.695318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:45.695318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] HTTP exception thrown: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Request method failure captured: Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e HTTP/1.1 Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UBx0SBh_Bv3GYHZagmfVQqa3oPIcTnBcahS1P_fNrccGkpNpXTwuhXAZAOaTUECMgMF_-kMnSsi0ieebYQAWSzIWCNNwVrvJezFkIZqFd9KGfCXD4HprMa0l40jBFIlIUKZvSp5GCQLLlst0Q01BCO28X-PqCQqc0kg7mAYC19j_w Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:33:45.695765 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/362ec4487088496a8198a3cf71815256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_362ec4487088496a8198a3cf71815256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 11be37af210c45fc9ddebf7f28b265ef Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:45.698341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '2357eb5b-b599-4cf5-828b-ef2d1ede6e7e'} Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:45.699547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:45.701139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:45.702484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Returning 404 to user: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:45.702484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-95fd55e2-6dfc-432f-a065-f0c58923c420 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 404 len: 111 microversion: 2.1 time: 0.035136 Aug 10 11:33:45.702484 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 580/1173] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:45 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:33:45.702753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ad24e0b6-fb31-477d-b9a0-bd1b78da4671 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '.version_select at 0x7f6f447eaaf0>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:46.034157 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ad24e0b6-fb31-477d-b9a0-bd1b78da4671 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-379378277" status: 202 len: 0 microversion: 2.1 time: 0.393587 Aug 10 11:33:46.034698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 594/1174] 10.222.0.13 () {58 vars in 1218 bytes} [Wed Aug 10 11:33:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-379378277 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:33:49.428947 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:49.429483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:49.436079 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:49.436555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:49.436985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:49.437659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:49.438102 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:49.438520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:49.453391 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] HTTP exception thrown: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Request method failure captured: Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e HTTP/1.1 Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UBx0SBh_Bv3GYHZagmfVQqa3oPIcTnBcahS1P_fNrccGkpNpXTwuhXAZAOaTUECMgMF_-kMnSsi0ieebYQAWSzIWCNNwVrvJezFkIZqFd9KGfCXD4HprMa0l40jBFIlIUKZvSp5GCQLLlst0Q01BCO28X-PqCQqc0kg7mAYC19j_w Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:33:49.455080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/362ec4487088496a8198a3cf71815256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_362ec4487088496a8198a3cf71815256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 11be37af210c45fc9ddebf7f28b265ef Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.456610 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '2357eb5b-b599-4cf5-828b-ef2d1ede6e7e'} Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:49.458068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.459983 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.462374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Returning 404 to user: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:49.462374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-976de01f-b7dd-4858-87a0-08e5748cc4aa tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 404 len: 111 microversion: 2.1 time: 0.031497 Aug 10 11:33:49.462374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 581/1175] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:33:49 2022] DELETE /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:33:49.467912 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:49.468656 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:49.471281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:33:49.476683 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:49.477171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:49.477585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:49.478268 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:49.478710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:49.479127 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:49.493405 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] HTTP exception thrown: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Request method failure captured: Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e HTTP/1.1 Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UBx0SBh_Bv3GYHZagmfVQqa3oPIcTnBcahS1P_fNrccGkpNpXTwuhXAZAOaTUECMgMF_-kMnSsi0ieebYQAWSzIWCNNwVrvJezFkIZqFd9KGfCXD4HprMa0l40jBFIlIUKZvSp5GCQLLlst0Q01BCO28X-PqCQqc0kg7mAYC19j_w Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:33:49.495538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/362ec4487088496a8198a3cf71815256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_362ec4487088496a8198a3cf71815256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 11be37af210c45fc9ddebf7f28b265ef Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.497106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '2357eb5b-b599-4cf5-828b-ef2d1ede6e7e'} Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:49.497978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. Aug 10 11:33:49.499158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:49.500283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Returning 404 to user: Instance 2357eb5b-b599-4cf5-828b-ef2d1ede6e7e could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:49.500283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f0e131a2-565c-4581-9d2a-ecaa05977bbe tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e" status: 404 len: 111 microversion: 2.1 time: 0.034768 Aug 10 11:33:49.500283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 595/1176] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:49 2022] GET /compute/v2.1/servers/2357eb5b-b599-4cf5-828b-ef2d1ede6e7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:33:50.876900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:50.877417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:50.883816 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.884338 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.884778 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.885469 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.885926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.886890 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.900275 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] HTTP exception thrown: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Request method failure captured: Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc HTTP/1.1 Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UBx0SBh_Bv3GYHZagmfVQqa3oPIcTnBcahS1P_fNrccGkpNpXTwuhXAZAOaTUECMgMF_-kMnSsi0ieebYQAWSzIWCNNwVrvJezFkIZqFd9KGfCXD4HprMa0l40jBFIlIUKZvSp5GCQLLlst0Q01BCO28X-PqCQqc0kg7mAYC19j_w Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:33:50.904352 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/362ec4487088496a8198a3cf71815256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_362ec4487088496a8198a3cf71815256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 11be37af210c45fc9ddebf7f28b265ef Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.905790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'b6aeb94b-88c4-4f5c-844a-5fff3d2848dc'} Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:50.906551 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.907780 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.909312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Returning 404 to user: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:50.909312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-47974077-5743-439c-b215-aa490283a128 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 404 len: 111 microversion: 2.1 time: 0.030905 Aug 10 11:33:50.909312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 582/1177] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:33:50 2022] DELETE /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:33:50.912489 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:33:50.913107 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] [instance: b6aeb94b-88c4-4f5c-844a-5fff3d2848dc] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:33:50.920056 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.920532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.920967 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.921654 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:33:50.922101 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:33:50.922530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:33:50.935810 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] HTTP exception thrown: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Request method failure captured: Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc HTTP/1.1 Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UBx0SBh_Bv3GYHZagmfVQqa3oPIcTnBcahS1P_fNrccGkpNpXTwuhXAZAOaTUECMgMF_-kMnSsi0ieebYQAWSzIWCNNwVrvJezFkIZqFd9KGfCXD4HprMa0l40jBFIlIUKZvSp5GCQLLlst0Q01BCO28X-PqCQqc0kg7mAYC19j_w Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:33:50.937281 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/362ec4487088496a8198a3cf71815256"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/362ec4487088496a8198a3cf71815256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_362ec4487088496a8198a3cf71815256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 362ec4487088496a8198a3cf71815256 Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1231085926 Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 11be37af210c45fc9ddebf7f28b265ef Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeTestJSON-1231085926-project Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.938955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'b6aeb94b-88c4-4f5c-844a-5fff3d2848dc'} Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:33:50.939774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. Aug 10 11:33:50.941128 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:33:50.942367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] Returning 404 to user: Instance b6aeb94b-88c4-4f5c-844a-5fff3d2848dc could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:33:50.942367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ed5af33d-62c3-4b3c-8858-551fa2fff6d7 tempest-AttachVolumeTestJSON-1231085926 tempest-AttachVolumeTestJSON-1231085926-project] 10.222.0.13 "GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc" status: 404 len: 111 microversion: 2.1 time: 0.030021 Aug 10 11:33:50.942367 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 596/1178] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:33:50 2022] GET /compute/v2.1/servers/b6aeb94b-88c4-4f5c-844a-5fff3d2848dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:34:45.142638 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:45.144775 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:45.147073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:45.147709 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:45.152363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:45.152844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:45.153274 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.153955 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:45.154400 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:45.154821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.183126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-42f5bef2-387e-4da7-b092-22e867c52b55 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045047 Aug 10 11:34:45.183665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 583/1179] 10.222.0.13 () {60 vars in 1343 bytes} [Wed Aug 10 11:34:45 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:34:45.246922 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:45.247442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:45.249600 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:34:45.255109 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:45.255593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:45.256094 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.256784 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:45.257239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:45.257687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.283545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Going to try to terminate instance {{(pid=118425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:34:45.603091 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f39ab470-5a52-424d-b593-c725f31d77e0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 204 len: 0 microversion: 2.20 time: 0.360133 Aug 10 11:34:45.603666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 597/1180] 10.222.0.13 () {60 vars in 1280 bytes} [Wed Aug 10 11:34:45 2022] DELETE /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:34:45.613016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:45.613620 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:45.620280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:45.623346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:45.623346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.623346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:45.623346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:45.623741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:45.760960 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:45.779716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:45.779716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:45.779716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a3a0b9e6-2723-46ae-b073-57412b505995 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.163332 Aug 10 11:34:45.780069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 584/1181] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:45 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:46.795576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:46.796222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:46.802661 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:46.803143 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:46.803577 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:46.804294 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:46.804750 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:46.805175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:46.938964 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:46.946809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:46.948336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:46.949502 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-65fc9884-04e2-43cf-b8aa-0bc31ac605b6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.158307 Aug 10 11:34:46.950055 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 598/1182] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:46 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:47.973880 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:47.974501 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:47.981774 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:47.982243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:47.982668 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:47.983343 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:47.983786 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:47.984228 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:48.116060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:48.123985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:48.126660 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:48.127392 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2efb84f2-6a14-41f1-aa25-93182a7762c6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.158565 Aug 10 11:34:48.127945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 585/1183] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:47 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:49.151246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:49.151846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:49.158855 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:49.159329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:49.159764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:49.160477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:49.160929 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:49.161354 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:49.287388 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:49.295290 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:49.296819 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:49.298026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a1b0a495-592c-48a1-90e1-5b57d6d43061 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.150690 Aug 10 11:34:49.298590 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 599/1184] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:49 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:50.321238 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:50.321854 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:50.328428 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:50.328990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:50.329445 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:50.330135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:50.330588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:50.331015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:50.466201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:50.475449 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:50.476969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:50.478125 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-dba4f9e4-580b-4fc0-bbb6-21760c559af0 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.160971 Aug 10 11:34:50.482639 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 586/1185] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:50 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:51.501999 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:51.502608 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:51.512416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.512416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.512416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.512416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:51.512825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:51.512825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:51.659943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:51.670451 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:51.672910 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:51.674698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-505e85f1-7cea-4394-9af4-debcd5784204 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1723 microversion: 2.20 time: 0.176775 Aug 10 11:34:51.688021 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 600/1186] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:51 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:52.383364 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-96633b8a-e52a-4bdc-b46b-58736728cdaa req-a28ccab4-e255-4f99-8092-6f631795f1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2cec8c-8c64-40a9-b670-ad87c1fd610a", "name": "network-vif-deleted", "tag": "bd96a90b-c857-43bf-8f27-2546cc225d06"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:34:52.395203 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-96633b8a-e52a-4bdc-b46b-58736728cdaa req-a28ccab4-e255-4f99-8092-6f631795f1ee service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.395203 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-96633b8a-e52a-4bdc-b46b-58736728cdaa req-a28ccab4-e255-4f99-8092-6f631795f1ee service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.395203 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-96633b8a-e52a-4bdc-b46b-58736728cdaa req-a28ccab4-e255-4f99-8092-6f631795f1ee service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.406734 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-96633b8a-e52a-4bdc-b46b-58736728cdaa req-a28ccab4-e255-4f99-8092-6f631795f1ee service nova] Creating event network-vif-deleted:bd96a90b-c857-43bf-8f27-2546cc225d06 for instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a on hv-cinder-85061 Aug 10 11:34:52.412475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-96633b8a-e52a-4bdc-b46b-58736728cdaa req-a28ccab4-e255-4f99-8092-6f631795f1ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231235 Aug 10 11:34:52.413433 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 587/1187] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:34:52.697926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:52.698585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:52.705653 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.706144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.706583 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.707285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.707737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.708193 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.740085 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:52.740573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:52.741013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:52.741456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lazy-loading 'fault' on Instance uuid ad2cec8c-8c64-40a9-b670-ad87c1fd610a {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:34:52.786716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:52.794655 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:52.796164 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '87adb637dd814cf8be9ff6c2a2bc26ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282c9e4b65d64085a0ba1a3d356f59fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:34:52.797307 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8ec60ea2-d14b-40a0-8863-2a6d811fb073 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 200 len: 1371 microversion: 2.20 time: 0.103323 Aug 10 11:34:52.797858 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 601/1188] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:52 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 11:34:53.821113 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:53.821807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:53.828139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:53.829232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:53.829729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:53.830478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:53.830941 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:53.831422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:53.845795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] HTTP exception thrown: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Request method failure captured: Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a HTTP/1.1 Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UDQ0H5gNfLsj5ABantfOzbl9Zd9z5gzzsAeVkjhKYIzuOM5OtUc-8EfSh6g5xsx8BdIeMCXG5-hv6qaJfHNzHhxvJy1sgpbMb3pfHv0FRbsbzyztolGlMHOFWjtT0sy2oFak41E-Pwb9WMGWRKiTIfV8_jxyhq8Y_lWqP34CVLArU Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:34:53.847432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 87adb637dd814cf8be9ff6c2a2bc26ea Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:53.849115 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'ad2cec8c-8c64-40a9-b670-ad87c1fd610a'} Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:34:53.849939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:53.851232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:53.852426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Returning 404 to user: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:34:53.852426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-bc0d75d9-5897-49c2-82e7-b82999f36356 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 404 len: 111 microversion: 2.20 time: 0.032544 Aug 10 11:34:53.852426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 588/1189] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:53 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:34:53.858050 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b56a54e9-1a3b-4432-a467-94d48dbda51e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '.version_select at 0x7f6f44a14820>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:53.964459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b56a54e9-1a3b-4432-a467-94d48dbda51e tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484906262" status: 204 len: 0 microversion: 2.20 time: 0.110425 Aug 10 11:34:53.965032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 602/1190] 10.222.0.13 () {60 vars in 1262 bytes} [Wed Aug 10 11:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484906262 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 11:34:56.122638 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:56.123202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:56.130731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:56.131288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:56.131726 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:56.132532 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:56.132986 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:56.133412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:56.147138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] HTTP exception thrown: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Request method failure captured: Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a HTTP/1.1 Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UDQ0H5gNfLsj5ABantfOzbl9Zd9z5gzzsAeVkjhKYIzuOM5OtUc-8EfSh6g5xsx8BdIeMCXG5-hv6qaJfHNzHhxvJy1sgpbMb3pfHv0FRbsbzyztolGlMHOFWjtT0sy2oFak41E-Pwb9WMGWRKiTIfV8_jxyhq8Y_lWqP34CVLArU Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:34:56.148729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 87adb637dd814cf8be9ff6c2a2bc26ea Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.150309 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'ad2cec8c-8c64-40a9-b670-ad87c1fd610a'} Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:34:56.153573 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.155417 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.157794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Returning 404 to user: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:34:56.157794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-fbba8954-ff28-49af-8580-295b96610673 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 404 len: 111 microversion: 2.20 time: 0.031438 Aug 10 11:34:56.157794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 589/1191] 10.222.0.13 () {60 vars in 1280 bytes} [Wed Aug 10 11:34:56 2022] DELETE /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:34:56.160201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:56.161402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: ad2cec8c-8c64-40a9-b670-ad87c1fd610a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:56.168614 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:56.169039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:56.169507 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:56.170235 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:56.170666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:56.171092 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:56.185357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] HTTP exception thrown: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Request method failure captured: Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a HTTP/1.1 Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UDQ0H5gNfLsj5ABantfOzbl9Zd9z5gzzsAeVkjhKYIzuOM5OtUc-8EfSh6g5xsx8BdIeMCXG5-hv6qaJfHNzHhxvJy1sgpbMb3pfHv0FRbsbzyztolGlMHOFWjtT0sy2oFak41E-Pwb9WMGWRKiTIfV8_jxyhq8Y_lWqP34CVLArU Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:34:56.187058 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 87adb637dd814cf8be9ff6c2a2bc26ea Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.189651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'ad2cec8c-8c64-40a9-b670-ad87c1fd610a'} Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:34:56.190472 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. Aug 10 11:34:56.191864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:56.193187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Returning 404 to user: Instance ad2cec8c-8c64-40a9-b670-ad87c1fd610a could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:34:56.193187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ad8cb18e-2199-477b-bf2c-3969bef5f30f tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a" status: 404 len: 111 microversion: 2.20 time: 0.034182 Aug 10 11:34:56.193187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 603/1192] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:56 2022] GET /compute/v2.1/servers/ad2cec8c-8c64-40a9-b670-ad87c1fd610a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:34:57.487854 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:57.488422 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:57.494808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:57.495286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:57.495718 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:57.496443 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:57.496884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:57.497302 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:57.511341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] HTTP exception thrown: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Request method failure captured: Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 HTTP/1.1 Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UDQ0H5gNfLsj5ABantfOzbl9Zd9z5gzzsAeVkjhKYIzuOM5OtUc-8EfSh6g5xsx8BdIeMCXG5-hv6qaJfHNzHhxvJy1sgpbMb3pfHv0FRbsbzyztolGlMHOFWjtT0sy2oFak41E-Pwb9WMGWRKiTIfV8_jxyhq8Y_lWqP34CVLArU Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:34:57.512896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 87adb637dd814cf8be9ff6c2a2bc26ea Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.514613 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'fcf17719-c01d-4bcc-8a23-83d1a8a1a492'} Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:34:57.515788 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.523543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.525145 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Returning 404 to user: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:34:57.525145 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-e85f420b-7246-4d44-b6db-b815dfb7fc29 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 404 len: 111 microversion: 2.20 time: 0.031133 Aug 10 11:34:57.525145 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 590/1193] 10.222.0.13 () {60 vars in 1280 bytes} [Wed Aug 10 11:34:57 2022] DELETE /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 11:34:57.529466 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:34:57.530017 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] [instance: fcf17719-c01d-4bcc-8a23-83d1a8a1a492] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:34:57.536881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:57.537357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:57.537827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:57.538501 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:34:57.538945 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:34:57.539362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:34:57.554416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] HTTP exception thrown: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Request method failure captured: Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 HTTP/1.1 Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UDQ0H5gNfLsj5ABantfOzbl9Zd9z5gzzsAeVkjhKYIzuOM5OtUc-8EfSh6g5xsx8BdIeMCXG5-hv6qaJfHNzHhxvJy1sgpbMb3pfHv0FRbsbzyztolGlMHOFWjtT0sy2oFak41E-Pwb9WMGWRKiTIfV8_jxyhq8Y_lWqP34CVLArU Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:34:57.555797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_282c9e4b65d64085a0ba1a3d356f59fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 282c9e4b65d64085a0ba1a3d356f59fa Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-498954672 Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 87adb637dd814cf8be9ff6c2a2bc26ea Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeShelveTestJSON-498954672-project Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.557213 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'fcf17719-c01d-4bcc-8a23-83d1a8a1a492'} Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:34:57.561550 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. Aug 10 11:34:57.564174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:34:57.565383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] Returning 404 to user: Instance fcf17719-c01d-4bcc-8a23-83d1a8a1a492 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:34:57.565383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7abd0b12-0314-414f-8f79-697c78d108d6 tempest-AttachVolumeShelveTestJSON-498954672 tempest-AttachVolumeShelveTestJSON-498954672-project] 10.222.0.13 "GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492" status: 404 len: 111 microversion: 2.20 time: 0.031694 Aug 10 11:34:57.565383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 604/1194] 10.222.0.13 () {60 vars in 1277 bytes} [Wed Aug 10 11:34:57 2022] GET /compute/v2.1/servers/fcf17719-c01d-4bcc-8a23-83d1a8a1a492 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 11:35:03.649276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:03.649805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:03.656257 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:03.657382 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:03.657823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:03.658505 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:03.658950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:03.659371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:03.681731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8b61e3eb-f309-4184-972e-8d06f132f6ff tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/ips" status: 200 len: 149 microversion: 2.1 time: 0.036367 Aug 10 11:35:03.682299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 591/1195] 10.222.0.13 () {58 vars in 1248 bytes} [Wed Aug 10 11:35:03 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:06.519372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad6eddb8-7f31-4b87-9951-abb58236e323"}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:06.521903 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:06.528681 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:06.529168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:06.529639 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:06.530329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:06.530781 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:06.531203 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:07.749827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1419acfd-3eff-4719-8009-2c7222790076 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "POST /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.234335 Aug 10 11:35:07.751363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 605/1196] 10.222.0.13 () {60 vars in 1323 bytes} [Wed Aug 10 11:35:06 2022] POST /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments => generated 194 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:22.854427 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:22.854957 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:22.857001 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=18 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:22.857659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=36 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:22.862286 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:22.862771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:22.863201 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:22.863888 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:22.864887 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:22.865404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:22.955807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'services' on Instance uuid e7d81c50-faa1-4e54-adee-c8c40b185bce {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:35:23.180968 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-334b2cc8-d4a4-4738-84a7-34fdd4fa4a38 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments/ad6eddb8-7f31-4b87-9951-abb58236e323" status: 202 len: 0 microversion: 2.1 time: 0.330350 Aug 10 11:35:23.181963 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 592/1197] 10.222.0.13 () {58 vars in 1416 bytes} [Wed Aug 10 11:35:22 2022] DELETE /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments/ad6eddb8-7f31-4b87-9951-abb58236e323 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:35:23.191374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:23.194700 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:23.198539 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:23.198539 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:23.204737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:23.205237 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:23.205678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:23.206491 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:23.207576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:23.209175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:23.240019 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c4cca5f9-5f2d-4425-a988-0ed9624bd067 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053210 Aug 10 11:35:23.240755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 606/1198] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:35:23 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:24.254326 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:24.256996 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:24.263198 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:24.263673 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:24.264152 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:24.264833 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:24.265282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:24.265710 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:24.295869 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2acaed2d-fb40-4108-ad5e-32eb0f76ad74 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046333 Aug 10 11:35:24.296447 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 593/1199] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:35:24 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:25.309047 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:25.311174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:25.318636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:25.319117 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:25.319552 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:25.320273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:25.320726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:25.321152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:25.351130 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-90d6e6bd-8af4-41ac-bdf1-8a54cb251938 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046798 Aug 10 11:35:25.351690 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 607/1200] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:35:25 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:26.363117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:26.366040 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:26.372592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:26.373064 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:26.373502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:26.374223 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:26.374676 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:26.375101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:26.403973 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a4f4efc7-7e0d-4893-9def-43fecdc74982 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Aug 10 11:35:26.404553 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 594/1201] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:35:26 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:27.416613 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:27.418807 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:27.427016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:27.427667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:27.428078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:27.428800 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:27.429256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:27.429686 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:27.460248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-96289f55-1778-44fb-8104-49f951b44ad9 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047951 Aug 10 11:35:27.460804 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 608/1202] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:35:27 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:28.475313 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:28.477559 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:28.484292 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.484769 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.485195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.485985 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.486427 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.486843 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.518727 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-77c4c50b-b76e-49c6-b1f5-d8512238b086 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049724 Aug 10 11:35:28.519835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 595/1203] 10.222.0.13 () {58 vars in 1302 bytes} [Wed Aug 10 11:35:28 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 11:35:28.584806 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:28.585352 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:28.593952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.605873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.605873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.605873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.605873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.606291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.627527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Going to try to terminate instance {{(pid=118425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:35:28.951338 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-dbc170f8-8e8e-4c51-870f-5db8cc0be4b8 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 204 len: 0 microversion: 2.1 time: 0.370515 Aug 10 11:35:28.951846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 609/1204] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:35:28 2022] DELETE /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:35:28.968289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:28.968906 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:28.975530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.976196 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.976666 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:28.977400 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:28.977859 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:28.978285 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:29.120736 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:29.128371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-23cc8e93-d492-4d22-9be9-d34d8c9bffd4 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1681 microversion: 2.1 time: 0.164143 Aug 10 11:35:29.128940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 596/1205] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:28 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:30.151571 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:30.152225 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:30.158602 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:30.159085 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:30.159527 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:30.160244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:30.160743 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:30.161370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:30.300110 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:30.308520 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4aa8415b-5e9c-487e-a395-c2bca1030147 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1681 microversion: 2.1 time: 0.161249 Aug 10 11:35:30.309090 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 610/1206] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:30 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:31.330586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:31.330979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:31.338571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:31.339052 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:31.339483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:31.340211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:31.340658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:31.341079 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:31.482221 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:31.495399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ae77ef47-eea5-43f3-8cc8-cc5acca49023 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1681 microversion: 2.1 time: 0.168769 Aug 10 11:35:31.496056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 597/1207] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:31 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:32.502259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-b483136e-6c84-4230-834c-de268d4f5482 req-9e476d97-cd41-4481-aa39-866c24993fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d81c50-faa1-4e54-adee-c8c40b185bce", "name": "network-vif-deleted", "tag": "4e984d70-1999-4239-a2e8-3190e84dad77"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:35:32.523857 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:32.524480 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:32.531874 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-b483136e-6c84-4230-834c-de268d4f5482 req-9e476d97-cd41-4481-aa39-866c24993fc0 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:32.537414 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-b483136e-6c84-4230-834c-de268d4f5482 req-9e476d97-cd41-4481-aa39-866c24993fc0 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:32.537876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-b483136e-6c84-4230-834c-de268d4f5482 req-9e476d97-cd41-4481-aa39-866c24993fc0 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:32.541274 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:32.541783 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:32.542224 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:32.542939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:32.545826 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:32.546297 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:32.562819 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-b483136e-6c84-4230-834c-de268d4f5482 req-9e476d97-cd41-4481-aa39-866c24993fc0 service nova] Creating event network-vif-deleted:4e984d70-1999-4239-a2e8-3190e84dad77 for instance e7d81c50-faa1-4e54-adee-c8c40b185bce on hv-cinder-85061 Aug 10 11:35:32.571841 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-b483136e-6c84-4230-834c-de268d4f5482 req-9e476d97-cd41-4481-aa39-866c24993fc0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074401 Aug 10 11:35:32.573829 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 611/1208] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:32.632945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:32.641567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-cb4a55a7-686a-45a6-a8dd-c5372d43e71c tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1613 microversion: 2.1 time: 0.123050 Aug 10 11:35:32.656586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 598/1209] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:32 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1613 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:33.667594 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:33.668456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:33.674642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:33.675151 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:33.675581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:33.676341 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:33.676798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:33.677222 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:33.742144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:33.749564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-41198dda-d9d9-4fe6-9526-2fb702a4dddc tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1613 microversion: 2.1 time: 0.086842 Aug 10 11:35:33.755540 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 612/1210] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:33 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:34.771249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:34.772626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:34.778974 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:34.779446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:34.779874 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:34.780589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:34.781038 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:34.781454 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:34.845789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:34.853959 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c2a0ce5c-a214-4f25-aa02-de832d48bc7f tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1613 microversion: 2.1 time: 0.086967 Aug 10 11:35:34.854603 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 599/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:34 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:35:35.874840 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:35.875454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:35.882517 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:35.882997 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:35.883437 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:35.884152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:35.884606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:35.885032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:35.917503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:35.917503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:35.917503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:35.917503 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lazy-loading 'fault' on Instance uuid e7d81c50-faa1-4e54-adee-c8c40b185bce {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:35:35.961315 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0782e27e2318438fbf155dfa9cb834b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2a3c6102fb4fe5bd9c9ef1b8f8e78b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:35:35.969330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4ecfae4c-1cd6-416e-bd25-f35cc66be986 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 200 len: 1331 microversion: 2.1 time: 0.098346 Aug 10 11:35:35.969898 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 613/1212] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:35 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:36.991226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:36.991890 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:36.998394 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:37.003358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:37.003358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:37.003358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:37.003358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:37.003720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:37.014503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce HTTP/1.1 Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:35:37.016168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:37.017873 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'e7d81c50-faa1-4e54-adee-c8c40b185bce'} Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:37.018847 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:37.020452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:37.022979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:37.022979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-367eeaf7-d95a-4687-b089-9871059f9b21 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 404 len: 111 microversion: 2.1 time: 0.030344 Aug 10 11:35:37.022979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 600/1213] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:36 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:37.027312 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1dd831ca-76e5-4e60-baea-e8b734afdc30 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '.version_select at 0x7f6f44908dc0>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:37.101340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1dd831ca-76e5-4e60-baea-e8b734afdc30 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-334149955" status: 202 len: 0 microversion: 2.1 time: 0.077762 Aug 10 11:35:37.101902 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 614/1214] 10.222.0.13 () {58 vars in 1218 bytes} [Wed Aug 10 11:35:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-334149955 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:35:39.270655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:39.271023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:39.278164 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:39.278652 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:39.279088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:39.279914 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:39.280400 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:39.280820 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:39.294511 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce HTTP/1.1 Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:35:39.296283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.297731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'e7d81c50-faa1-4e54-adee-c8c40b185bce'} Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:39.298498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.299731 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.301027 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:39.301027 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1650c401-d527-4342-bd46-1dec307f8372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 404 len: 111 microversion: 2.1 time: 0.031585 Aug 10 11:35:39.301027 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 601/1215] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:35:39 2022] DELETE /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:39.307342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:39.308089 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: e7d81c50-faa1-4e54-adee-c8c40b185bce] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:39.314474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:39.320477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:39.320477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:39.320477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:39.320477 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:39.320869 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:39.330871 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce HTTP/1.1 Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:35:39.332546 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.333939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'e7d81c50-faa1-4e54-adee-c8c40b185bce'} Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:39.334713 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. Aug 10 11:35:39.336015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:39.337259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance e7d81c50-faa1-4e54-adee-c8c40b185bce could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:39.337259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-1d00ce99-4437-438a-8814-667c7ef19bc5 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce" status: 404 len: 111 microversion: 2.1 time: 0.031409 Aug 10 11:35:39.337259 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 615/1216] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:39 2022] GET /compute/v2.1/servers/e7d81c50-faa1-4e54-adee-c8c40b185bce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:45.988374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:45.988374 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:45.990865 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:45.990865 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:45.990865 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:45.990865 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:45.991283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:45.991283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.008825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 HTTP/1.1 Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:35:46.010307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.011851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '5007f939-3f30-4d48-b73a-97e538672837'} Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:46.012809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.025222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.026951 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:46.026951 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d5e41578-551b-465e-aaa5-db0f74616031 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 404 len: 111 microversion: 2.1 time: 0.035452 Aug 10 11:35:46.026951 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 602/1217] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:35:45 2022] DELETE /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:46.027210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:46.027210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: 5007f939-3f30-4d48-b73a-97e538672837] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:46.028469 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.028955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.029382 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.030066 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.030514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.030930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.045159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 HTTP/1.1 Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:35:46.046670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.048269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '5007f939-3f30-4d48-b73a-97e538672837'} Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:46.049078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. Aug 10 11:35:46.050313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.051397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance 5007f939-3f30-4d48-b73a-97e538672837 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:46.051397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fe586175-a752-4c8d-ba20-7e17459c54ca tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837" status: 404 len: 111 microversion: 2.1 time: 0.030544 Aug 10 11:35:46.051397 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 616/1218] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:46 2022] GET /compute/v2.1/servers/5007f939-3f30-4d48-b73a-97e538672837 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:46.057024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:46.057507 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:46.063439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.063920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.064373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.065061 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.065687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.066118 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.082002 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 HTTP/1.1 Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:35:46.083631 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.085234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'baf2a390-b869-4d2f-9013-63011c65a796'} Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:46.086803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.088363 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.090226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:46.090226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7e72835e-9f13-423f-b92f-e321991ce760 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 404 len: 111 microversion: 2.1 time: 0.032010 Aug 10 11:35:46.090226 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 603/1219] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:35:46 2022] DELETE /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:46.095571 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:46.096223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: baf2a390-b869-4d2f-9013-63011c65a796] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:46.102334 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.103044 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.103651 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.104402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:46.104838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:46.105264 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:46.121330 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 HTTP/1.1 Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:35:46.122854 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.124410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'baf2a390-b869-4d2f-9013-63011c65a796'} Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:46.125385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. Aug 10 11:35:46.126917 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:46.128456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance baf2a390-b869-4d2f-9013-63011c65a796 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:46.128456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-049ac914-dddd-4a41-a7f6-4f78ef3e282b tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796" status: 404 len: 111 microversion: 2.1 time: 0.032654 Aug 10 11:35:46.128456 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 617/1220] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:46 2022] GET /compute/v2.1/servers/baf2a390-b869-4d2f-9013-63011c65a796 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:47.456242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:47.456860 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:47.464964 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:47.465444 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:47.465877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:47.466563 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:47.467035 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:47.467457 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:47.481564 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 HTTP/1.1 Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:35:47.484846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.487795 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': 'ab6e3975-83d1-4eed-944c-38567ce25a00'} Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:47.489644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.492317 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.494958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:47.494958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b596ac73-b1f7-475c-95c6-78bbd13940e6 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 404 len: 111 microversion: 2.1 time: 0.032238 Aug 10 11:35:47.494958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 604/1221] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:35:47 2022] DELETE /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:47.496999 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:47.497957 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] [instance: ab6e3975-83d1-4eed-944c-38567ce25a00] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:35:47.504387 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:47.504861 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:47.505291 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:47.505965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:35:47.506409 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:35:47.506827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:35:47.520608 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] HTTP exception thrown: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Request method failure captured: Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 HTTP/1.1 Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85UHl2HBGHfHo4Wsj1YpOeT4OTIji1llHGPFWcjZOiM7st-URhfeVduhZaSIvBjp_DDfOX-Mr22YcW9hGTb17ieFs_fpZagLZ1puuEosUEQheiqGRc6pyxXH1BAD3QNo0UnTM-sjL9IediAkET9uVIukkBvEyLNq8MSBSXeu5GyX-lI Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:35:47.522126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b2a3c6102fb4fe5bd9c9ef1b8f8e78b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: 0b2a3c6102fb4fe5bd9c9ef1b8f8e78b Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1462183377 Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 0782e27e2318438fbf155dfa9cb834b6 Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-AttachVolumeNegativeTest-1462183377-project Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.523708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'ab6e3975-83d1-4eed-944c-38567ce25a00'} Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:35:47.525454 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. Aug 10 11:35:47.526927 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:35:47.528449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] Returning 404 to user: Instance ab6e3975-83d1-4eed-944c-38567ce25a00 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:35:47.528449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5f926e6b-8446-46e1-bfa9-74e3e1b14372 tempest-AttachVolumeNegativeTest-1462183377 tempest-AttachVolumeNegativeTest-1462183377-project] 10.222.0.13 "GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00" status: 404 len: 111 microversion: 2.1 time: 0.032485 Aug 10 11:35:47.528449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 618/1222] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:35:47 2022] GET /compute/v2.1/servers/ab6e3975-83d1-4eed-944c-38567ce25a00 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:35:56.009399 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-eac4ac09-466a-47f2-bc4f-83ad2a271d5f tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f37ffcee0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:56.060108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-eac4ac09-466a-47f2-bc4f-83ad2a271d5f tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e1ad3be5-8125-4dc6-90ee-495db2ea5f01" status: 200 len: 349 microversion: 2.1 time: 0.054477 Aug 10 11:35:56.060679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 605/1223] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:35:56 2022] GET /compute/v2.1/os-volumes/e1ad3be5-8125-4dc6-90ee-495db2ea5f01 => generated 349 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:57.641889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7e2a34d1-c95e-41e7-91b5-8b6b3b2bfd4d tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f448cb430>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:57.649064 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:57.649793 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:57.691233 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7e2a34d1-c95e-41e7-91b5-8b6b3b2bfd4d tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d9648f3f-1401-439a-bb67-f4bce30350c1" status: 200 len: 351 microversion: 2.1 time: 0.053157 Aug 10 11:35:57.692979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 619/1224] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:35:57 2022] GET /compute/v2.1/os-volumes/d9648f3f-1401-439a-bb67-f4bce30350c1 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:59.364542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:35:59.364542 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:35:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:35:59.502357 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=26 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:59.503168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:35:59.507043 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-231440e9-581a-4dfc-a859-30af00467df2 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f44348790>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:59.555267 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-231440e9-581a-4dfc-a859-30af00467df2 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/94bbde5f-476e-408e-924e-6044dd350f1e" status: 200 len: 350 microversion: 2.1 time: 0.054212 Aug 10 11:35:59.557283 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 606/1225] 10.222.0.13 () {58 vars in 1245 bytes} [Wed Aug 10 11:35:59 2022] GET /compute/v2.1/os-volumes/94bbde5f-476e-408e-924e-6044dd350f1e => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:59.569386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b34f9716-278e-4514-b535-35430cff0810 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f44821ca0>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:59.657415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b34f9716-278e-4514-b535-35430cff0810 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.092972 Aug 10 11:35:59.657978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 620/1226] 10.222.0.13 () {58 vars in 1134 bytes} [Wed Aug 10 11:35:59 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:59.671835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6f298409-c992-4f46-978b-bc976f2b4095 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f45c7bc10>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:59.758719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6f298409-c992-4f46-978b-bc976f2b4095 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091108 Aug 10 11:35:59.759386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 607/1227] 10.222.0.13 () {58 vars in 1149 bytes} [Wed Aug 10 11:35:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:59.774338 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-258c4376-b35d-4f94-a5cd-c6737c3970f3 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f4479d700>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:59.859134 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-258c4376-b35d-4f94-a5cd-c6737c3970f3 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089126 Aug 10 11:35:59.859704 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 621/1228] 10.222.0.13 () {58 vars in 1134 bytes} [Wed Aug 10 11:35:59 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:35:59.873588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-35de7843-6007-4410-8fea-c1b01cc7b125 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f444075e0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:35:59.958483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-35de7843-6007-4410-8fea-c1b01cc7b125 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089789 Aug 10 11:35:59.959056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 608/1229] 10.222.0.13 () {58 vars in 1167 bytes} [Wed Aug 10 11:35:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:35:59.972519 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ef612ad3-d9ab-4141-a2cd-5a4acf3d4be9 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f4490da60>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:00.060216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ef612ad3-d9ab-4141-a2cd-5a4acf3d4be9 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091325 Aug 10 11:36:00.060794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 622/1230] 10.222.0.13 () {58 vars in 1170 bytes} [Wed Aug 10 11:35:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:36:00.074956 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-131ef72f-53fc-4248-b0f5-685492a79eca tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f46d8d550>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:00.160745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-131ef72f-53fc-4248-b0f5-685492a79eca tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088572 Aug 10 11:36:00.160745 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 609/1231] 10.222.0.13 () {58 vars in 1155 bytes} [Wed Aug 10 11:36:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:00.173198 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e236d890-c2a8-4dd7-a490-aedbe25dbb1f tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f44821c10>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:00.255812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e236d890-c2a8-4dd7-a490-aedbe25dbb1f tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086995 Aug 10 11:36:00.256513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 623/1232] 10.222.0.13 () {58 vars in 1188 bytes} [Wed Aug 10 11:36:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:36:00.271227 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5240099c-d447-4a65-89f9-c2ba3689ab64 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] Calling method '.version_select at 0x7f6f4407f0d0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:36:00.360902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5240099c-d447-4a65-89f9-c2ba3689ab64 tempest-VolumesTestJSON-1403901373 tempest-VolumesTestJSON-1403901373-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.093740 Aug 10 11:36:00.361548 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 610/1233] 10.222.0.13 () {58 vars in 1155 bytes} [Wed Aug 10 11:36:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:36:01.883479 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:36:01.884079 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Wed Aug 10 11:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:36:54.396494 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-12cd0b82-33de-42f2-b569-fa61124f0f60 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Action: 'create', calling method: .version_select at 0x7f6f4490d160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1626919928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLi6GJ6v5BeD7EvhXfWJ0qaeWrC2CLYQMqisQiaeQXjrqF9Ey3RhcH/AnGSZdlpT2woysFDfKaURnqP9Se3gPnkQJCBNYmBqJRWvOQAihUSPTXfqbWQ+J3XRBwpFfLf+g=="}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:36:54.413184 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-12cd0b82-33de-42f2-b569-fa61124f0f60 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Getting quotas for project e8775e002af14ee2ac9d6601a6872dfa. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:36:54.417357 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-12cd0b82-33de-42f2-b569-fa61124f0f60 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Getting quotas for user 63e9c06c2c4f4caabf6ecd67cece94f4 and project e8775e002af14ee2ac9d6601a6872dfa. Resources: {'key_pairs'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:36:54.512629 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-12cd0b82-33de-42f2-b569-fa61124f0f60 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.296927 Aug 10 11:36:54.513229 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 624/1234] 10.222.0.13 () {60 vars in 1159 bytes} [Wed Aug 10 11:36:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:15.910565 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-303510411", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "networks": [{"uuid": "d84b2ca4-6c30-404b-bfc1-a9c501ffffe0"}]}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:15.963234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] validate_networks() for [('d84b2ca4-6c30-404b-bfc1-a9c501ffffe0', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:37:16.369719 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:37:16.370171 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:37:16.370645 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:37:16.371054 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:37:16.371825 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:37:16.384989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:16.384989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:16.384989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:16.384989 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:16.385503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:16.385503 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:16.401086 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Getting quotas for project a8deb71dfa2045f2819d87ee669fcc65. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:37:16.405060 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Getting quotas for user a551273dd0384df392f9c391357f7fbf and project a8deb71dfa2045f2819d87ee669fcc65. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:37:16.416395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:37:16.418639 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:37:16.538540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [2fb0bfc5-ab91-4f19-8b68-04c899a19741] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 11:37:17.546275 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [2fb0bfc5-ab91-4f19-8b68-04c899a19741] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54992. Aug 10 11:37:17.550297 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-292b17e8-0f5f-4b9a-977c-d10f62d44ef3 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.645315 Aug 10 11:37:17.550926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 611/1235] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:37:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:37:17.561709 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ce1a61a2-4a13-44ce-96ff-392aebd3607e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:17.562347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ce1a61a2-4a13-44ce-96ff-392aebd3607e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:17.565391 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:17.567037 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:17.619614 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ce1a61a2-4a13-44ce-96ff-392aebd3607e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:17.626880 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ce1a61a2-4a13-44ce-96ff-392aebd3607e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1213 microversion: 2.1 time: 0.069016 Aug 10 11:37:17.627404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 625/1236] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:17 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:18.647772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9107727a-27fd-4455-a820-38c7f865412b tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:18.648412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9107727a-27fd-4455-a820-38c7f865412b tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:18.699024 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9107727a-27fd-4455-a820-38c7f865412b tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:18.707346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9107727a-27fd-4455-a820-38c7f865412b tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1213 microversion: 2.1 time: 0.063964 Aug 10 11:37:18.707896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 612/1237] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:18 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:19.728592 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:19.729256 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:19.736711 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:19.742582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:19.742582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:19.742582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:19.742582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:19.743000 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:19.803948 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:19.811306 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-693c062c-1543-45f4-b1d8-170b49d23da6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1265 microversion: 2.1 time: 0.087350 Aug 10 11:37:19.811881 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 626/1238] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:19 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:20.218323 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-160752075", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1626919928", "security_groups": [{"name": "tempest-secgroup-smoke-1086611563"}], "block_device_mapping_v2": [{"uuid": "e79c9c20-7089-47fe-b6ea-9e5cc3b72dac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd56801a-9245-407d-8810-39f61a13c5db"}]}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:20.342540 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] validate_networks() for [('fd56801a-9245-407d-8810-39f61a13c5db', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:37:20.737271 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:37:20.737696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:37:20.742733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:37:20.742733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:37:20.742733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:37:20.748179 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:20.748886 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:20.749335 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:20.750037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:20.750658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:20.751084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:20.771920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Getting quotas for project e8775e002af14ee2ac9d6601a6872dfa. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:37:20.771920 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Getting quotas for user 63e9c06c2c4f4caabf6ecd67cece94f4 and project e8775e002af14ee2ac9d6601a6872dfa. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:37:20.832653 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:37:20.834883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e79c9c20-7089-47fe-b6ea-9e5cc3b72dac',volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:37:20.836548 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:20.837227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:20.850599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:20.851075 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:20.851963 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:20.852279 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:20.852714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:20.853133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:20.987440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:20.997065 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6b0b4230-de14-4b03-b727-447eb9a67c4a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.164264 Aug 10 11:37:20.997645 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 627/1239] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:20 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:21.516744 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-438a150a-6dbd-43ef-8cfa-3367ae66367c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.302479 Aug 10 11:37:21.517832 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 613/1240] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:37:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:37:21.531789 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c7d4b512-e698-4775-9d1d-84d2f7568eed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:21.534748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c7d4b512-e698-4775-9d1d-84d2f7568eed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:21.596846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c7d4b512-e698-4775-9d1d-84d2f7568eed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:21.602430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c7d4b512-e698-4775-9d1d-84d2f7568eed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1094 microversion: 2.1 time: 0.077622 Aug 10 11:37:21.603004 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 628/1241] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:21 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:21.773478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-0d674cad-5973-4d5b-918f-6596c37568ad req-5bf10b47-954a-4e41-850a-396872ce857b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c118037-44ea-439d-baf5-78bf115ae52a", "tag": "7d6defd6-8f86-4678-8033-59cce66c35a8"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:21.784418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0d674cad-5973-4d5b-918f-6596c37568ad req-5bf10b47-954a-4e41-850a-396872ce857b service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:21.784900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0d674cad-5973-4d5b-918f-6596c37568ad req-5bf10b47-954a-4e41-850a-396872ce857b service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:21.785330 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-0d674cad-5973-4d5b-918f-6596c37568ad req-5bf10b47-954a-4e41-850a-396872ce857b service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:21.796696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-0d674cad-5973-4d5b-918f-6596c37568ad req-5bf10b47-954a-4e41-850a-396872ce857b service nova] Creating event network-changed:7d6defd6-8f86-4678-8033-59cce66c35a8 for instance 0c118037-44ea-439d-baf5-78bf115ae52a on hv-cinder-85061 Aug 10 11:37:21.802513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-0d674cad-5973-4d5b-918f-6596c37568ad req-5bf10b47-954a-4e41-850a-396872ce857b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033948 Aug 10 11:37:21.809671 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 614/1242] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:22.079337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:22.080220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:22.087884 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:22.089010 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:22.089769 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:22.090481 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:22.091197 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:22.091633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:22.238074 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:22.245682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fa54e9b1-341f-48e2-a77a-5fc6c351af05 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.170822 Aug 10 11:37:22.246245 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 629/1243] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:22 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:22.623232 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:22.623931 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:22.630669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:22.631150 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:22.631585 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:22.632304 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:22.632756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:22.633177 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:22.695039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:22.702489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7d06df14-89bd-4f55-90b8-972ec48162fe tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1144 microversion: 2.1 time: 0.083545 Aug 10 11:37:22.703098 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 615/1244] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:22 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:23.268133 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:23.268715 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:23.275144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:23.275625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:23.276080 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:23.276772 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:23.277223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:23.277650 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:23.408446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:23.415842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ae471d71-9469-48a4-92de-787fa53274cb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.152218 Aug 10 11:37:23.416440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 630/1245] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:23 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:23.722864 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:23.723473 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:23.729879 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:23.730358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:23.730807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:23.731477 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:23.731923 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:23.732375 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:23.798128 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:23.805414 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4433b1fe-81d1-4098-931a-f0bda5c05d30 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1144 microversion: 2.1 time: 0.086593 Aug 10 11:37:23.805974 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 616/1246] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:23 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:24.437031 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:24.438248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:24.444530 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:24.445005 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:24.445438 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:24.446114 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:24.446560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:24.446978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:24.575108 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:24.583350 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9be1e9bd-a263-44d1-a728-42dc720ec9bd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.150509 Aug 10 11:37:24.583904 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 631/1247] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:24 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:24.826316 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:24.827051 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:24.834691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:24.835214 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:24.838489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:24.838489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:24.838489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:24.838489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:24.898276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:24.905760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f2f09da6-cbf0-4c03-a97a-1c36c673f402 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1144 microversion: 2.1 time: 0.083295 Aug 10 11:37:24.906964 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 617/1248] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:24 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:25.605244 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:25.655126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:25.655126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.655126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.655126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.655575 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.655575 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.655575 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.752402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:25.760512 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-2b00e310-e9a5-4f8f-92d1-0ead5bb28f29 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.160092 Aug 10 11:37:25.766918 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 632/1249] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:25 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:25.927063 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:25.927651 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:25.935373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.937211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.937211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:25.937211 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:25.938707 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:25.938707 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:26.002586 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:26.010016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-013c435a-89d0-493a-adc8-afc6737b45da tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1200 microversion: 2.1 time: 0.087178 Aug 10 11:37:26.010940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 618/1250] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:25 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:26.782399 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:26.783028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:26.790883 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:26.791737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:26.792457 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:26.793393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:26.794060 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:26.794956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.040143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:27.040143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:27.049655 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.051042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.051791 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.053552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.055223 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.056401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.077609 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:27.091599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-49a3e487-efe7-469c-ac27-0c5025493165 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.308077 Aug 10 11:37:27.091599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 633/1251] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:26 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:27.206884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:27.215113 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-07e1c12c-a264-4a2b-91a4-492b48d84f02 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1278 microversion: 2.1 time: 0.187511 Aug 10 11:37:27.229821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 619/1252] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:27 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:27.762898 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-ebdc1d53-a9df-4084-aae6-5519cf815e1a req-68a4b984-5a0a-491d-8a18-92d5cde2e543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "436b2015-f279-44db-9913-99eac99179bf", "tag": "152737fa-7152-4e06-8248-ce310b32d7de"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:27.774028 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ebdc1d53-a9df-4084-aae6-5519cf815e1a req-68a4b984-5a0a-491d-8a18-92d5cde2e543 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:27.774514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ebdc1d53-a9df-4084-aae6-5519cf815e1a req-68a4b984-5a0a-491d-8a18-92d5cde2e543 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:27.774943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-ebdc1d53-a9df-4084-aae6-5519cf815e1a req-68a4b984-5a0a-491d-8a18-92d5cde2e543 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:27.787467 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-ebdc1d53-a9df-4084-aae6-5519cf815e1a req-68a4b984-5a0a-491d-8a18-92d5cde2e543 service nova] Creating event network-changed:152737fa-7152-4e06-8248-ce310b32d7de for instance 436b2015-f279-44db-9913-99eac99179bf on hv-cinder-85061 Aug 10 11:37:27.793080 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-ebdc1d53-a9df-4084-aae6-5519cf815e1a req-68a4b984-5a0a-491d-8a18-92d5cde2e543 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035121 Aug 10 11:37:27.794201 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 634/1253] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:37:28.107354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:28.107961 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:28.116891 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.117378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.117800 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.118483 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.118927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.119346 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.240441 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:28.241145 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:28.247726 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.248247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.248680 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.249564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.250528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.250957 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.345480 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:28.353543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9fe5fba4-66ed-4b27-95f7-67e3b6d649fd tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.250092 Aug 10 11:37:28.354117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 620/1254] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:28 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:28.411092 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:28.418615 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a7268919-a1f0-4a02-9261-f17348db448f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.182422 Aug 10 11:37:28.419182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 635/1255] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:28 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:28.746242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-5704ac6e-63ef-4ce1-ab17-056a09bde781 req-87211f9f-2ef1-4e2a-ace4-328c191ef0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c118037-44ea-439d-baf5-78bf115ae52a", "name": "network-vif-plugged", "status": "completed", "tag": "7d6defd6-8f86-4678-8033-59cce66c35a8"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:28.756236 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-5704ac6e-63ef-4ce1-ab17-056a09bde781 req-87211f9f-2ef1-4e2a-ace4-328c191ef0e3 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:28.756701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-5704ac6e-63ef-4ce1-ab17-056a09bde781 req-87211f9f-2ef1-4e2a-ace4-328c191ef0e3 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:28.757125 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-5704ac6e-63ef-4ce1-ab17-056a09bde781 req-87211f9f-2ef1-4e2a-ace4-328c191ef0e3 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:28.768234 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-5704ac6e-63ef-4ce1-ab17-056a09bde781 req-87211f9f-2ef1-4e2a-ace4-328c191ef0e3 service nova] Creating event network-vif-plugged:7d6defd6-8f86-4678-8033-59cce66c35a8 for instance 0c118037-44ea-439d-baf5-78bf115ae52a on hv-cinder-85061 Aug 10 11:37:28.773462 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-5704ac6e-63ef-4ce1-ab17-056a09bde781 req-87211f9f-2ef1-4e2a-ace4-328c191ef0e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087925 Aug 10 11:37:28.774042 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 621/1256] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:29.374187 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:29.374849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:29.382079 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.382561 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.382995 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.383682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.384221 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.389462 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.440844 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:29.441575 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:29.448332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.453475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.453475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.453475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:29.453475 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:29.453945 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:29.557098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:29.566240 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9e64033d-cc8c-4a09-8145-f0e64ae2aae5 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.195811 Aug 10 11:37:29.566908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 636/1257] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:29 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:29.605574 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:29.613222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-08f679ab-ace4-414b-a2d1-60c0c14a2cff tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.176996 Aug 10 11:37:29.613779 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 622/1258] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:29 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:30.587611 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:30.588279 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:30.595737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:30.596247 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:30.596683 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.597369 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:30.597822 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:30.598250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.633724 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:30.634277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:30.641318 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:30.641810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:30.642241 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.642931 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:30.643372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:30.643790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:30.758900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=4 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:30.778376 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=14 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:30.783484 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:30.790994 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c9007530-c283-4097-9d54-878e8751b786 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1313 microversion: 2.1 time: 0.207181 Aug 10 11:37:30.791660 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 637/1259] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:30 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:30.811434 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:30.818977 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-6bc952bf-855d-4e97-90c6-f4b797b467ed tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.189129 Aug 10 11:37:30.819543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 623/1260] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:30 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:31.812270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:31.812958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:31.815513 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:31.820326 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.820950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.821381 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.822068 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.822606 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.823032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.840166 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:31.840877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:31.849297 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.849811 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.850267 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:31.851008 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:31.851460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:31.851886 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:32.025336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:32.033774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b47c370e-d97c-4b4c-b16d-09f263991f02 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1497 microversion: 2.1 time: 0.225372 Aug 10 11:37:32.034420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 638/1261] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:31 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1497 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:32.039969 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:32.048117 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-752bfec0-1815-4a1a-863a-c3ce3b34d611 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.212024 Aug 10 11:37:32.050708 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 624/1262] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:31 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:37:33.068969 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:33.069588 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:33.070359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:33.070953 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:33.076267 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:33.076764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:33.077203 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:33.077407 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:33.077941 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:33.078448 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:33.078666 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:33.078803 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:33.078895 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:33.079056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:33.079506 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:33.079927 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:33.105242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:37:33.214851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:33.223190 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-622dc2dd-5356-4e3a-b4ab-70d197d6f893 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.158149 Aug 10 11:37:33.223793 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 639/1263] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:33 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:33.435900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-21ca749a-c5e1-4791-a6f8-a99ef91c5470 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 204 len: 0 microversion: 2.1 time: 0.369262 Aug 10 11:37:33.436525 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 625/1264] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:37:33 2022] DELETE /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:37:33.444687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:33.445340 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:33.451169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:33.451642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:33.452100 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:33.452779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:33.453848 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:33.454270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:33.581537 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:33.589015 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cecc45ef-5505-48e1-9b8d-ffb3e553cb32 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1503 microversion: 2.1 time: 0.148144 Aug 10 11:37:33.589839 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 640/1265] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:33 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:34.244777 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:34.245480 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:34.252266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:34.252753 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:34.253196 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:34.253884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:34.254339 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:34.254767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:34.387466 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:34.395626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a43aab35-8867-46c4-8c53-38f435d776a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.155019 Aug 10 11:37:34.396246 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 626/1266] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:34 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:34.610828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:34.611442 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:34.617838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:34.618319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:34.618752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:34.619431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:34.619878 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:34.620321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:34.752938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:34.760525 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b3d498f3-3767-4c06-aa46-1c5baeee2e6e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1503 microversion: 2.1 time: 0.153780 Aug 10 11:37:34.761098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 641/1267] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:34 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:35.416792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:35.417401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:35.424460 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:35.424931 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:35.425357 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:35.426034 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:35.426478 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:35.426895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:35.555184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:35.563650 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b9a04d54-7fe8-4e16-a9ce-55cad7cf4062 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.149582 Aug 10 11:37:35.564265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 627/1268] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:35 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:35.782833 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:35.783374 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:35.789669 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:35.790154 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:35.790585 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:35.791271 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:35.791721 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:35.792185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:35.924788 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:35.932129 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d8936e34-5ee2-45aa-9d0d-73a7980dbaf6 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1503 microversion: 2.1 time: 0.153852 Aug 10 11:37:35.932692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 642/1269] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:35 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:36.466091 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-71c716d7-04f8-43e6-93a0-b8ee4217b55e req-8e1ba160-69b4-4b31-b896-4014398b466a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c118037-44ea-439d-baf5-78bf115ae52a", "name": "network-vif-deleted", "tag": "7d6defd6-8f86-4678-8033-59cce66c35a8"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:36.476119 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-71c716d7-04f8-43e6-93a0-b8ee4217b55e req-8e1ba160-69b4-4b31-b896-4014398b466a service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:36.478072 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-71c716d7-04f8-43e6-93a0-b8ee4217b55e req-8e1ba160-69b4-4b31-b896-4014398b466a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:36.478072 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-71c716d7-04f8-43e6-93a0-b8ee4217b55e req-8e1ba160-69b4-4b31-b896-4014398b466a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:36.490741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-71c716d7-04f8-43e6-93a0-b8ee4217b55e req-8e1ba160-69b4-4b31-b896-4014398b466a service nova] Creating event network-vif-deleted:7d6defd6-8f86-4678-8033-59cce66c35a8 for instance 0c118037-44ea-439d-baf5-78bf115ae52a on hv-cinder-85061 Aug 10 11:37:36.495718 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-71c716d7-04f8-43e6-93a0-b8ee4217b55e req-8e1ba160-69b4-4b31-b896-4014398b466a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033645 Aug 10 11:37:36.496415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 628/1270] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:36.584621 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:36.585262 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:36.591638 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:36.592157 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:36.592603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:36.593303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:36.593786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:36.594345 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:36.729458 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:36.737182 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-735dc175-29d2-4c9b-b782-552ef210b400 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.156400 Aug 10 11:37:36.737741 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 643/1271] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:36 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:36.954789 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:36.955411 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:36.961627 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:36.962109 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:36.962542 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:36.963241 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:36.963680 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:36.964137 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:36.994685 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:36.995170 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:36.995606 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:36.996073 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lazy-loading 'fault' on Instance uuid 0c118037-44ea-439d-baf5-78bf115ae52a {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:37:37.038066 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:37.041514 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:37.045803 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5684d06c-9625-4010-8522-4bbf7d89ce3e tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 200 len: 1303 microversion: 2.1 time: 0.095951 Aug 10 11:37:37.046392 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 629/1272] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:36 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:37.758284 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:37.758824 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:37.765172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:37.765729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:37.766161 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:37.766844 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:37.767293 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:37.767716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:37.771733 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=100 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:37.902265 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:37.910453 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a153bb8b-6505-46b4-b195-7d0e0bbc4aa1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.156209 Aug 10 11:37:37.911013 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 644/1273] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:37 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:38.067015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:38.067624 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 0c118037-44ea-439d-baf5-78bf115ae52a] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:38.074646 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:38.075126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:38.075578 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:38.076270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:38.076721 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:38.077141 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:38.090617 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] HTTP exception thrown: Instance 0c118037-44ea-439d-baf5-78bf115ae52a could not be found. Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Request method failure captured: Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a HTTP/1.1 Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85hoLVlOdnODFBBuBvFXi4REBU3FzphJzSe2g24soylOMU76t52IlV_cVN1I_I8exUOLRBpi9Gxar_j8M15kX0gFlQ_5-unV73Iilsk7qEeV3qUa-UCa6N90MwqX8zGvvCqOdUz3_EJro2OP1dbmLD48XawjuwLxMiw_8Do2HXJOJ-I Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: a8deb71dfa2045f2819d87ee669fcc65 Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesActionsTest-395806551 Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:37:38.092270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8deb71dfa2045f2819d87ee669fcc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a8deb71dfa2045f2819d87ee669fcc65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8deb71dfa2045f2819d87ee669fcc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a8deb71dfa2045f2819d87ee669fcc65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesActionsTest-395806551 Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: a8deb71dfa2045f2819d87ee669fcc65 Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesActionsTest-395806551 Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesActionsTest-395806551-project Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: a551273dd0384df392f9c391357f7fbf Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesActionsTest-395806551-project Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 0c118037-44ea-439d-baf5-78bf115ae52a could not be found. Aug 10 11:37:38.094669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '0c118037-44ea-439d-baf5-78bf115ae52a'} Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c118037-44ea-439d-baf5-78bf115ae52a could not be found. Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:37:38.095588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c118037-44ea-439d-baf5-78bf115ae52a could not be found. Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c118037-44ea-439d-baf5-78bf115ae52a could not be found. Aug 10 11:37:38.097282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:38.098622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Returning 404 to user: Instance 0c118037-44ea-439d-baf5-78bf115ae52a could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:37:38.098622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0efa00aa-701f-4a00-a9ac-bfc95a41dbad tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a" status: 404 len: 111 microversion: 2.1 time: 0.030527 Aug 10 11:37:38.098622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 630/1274] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:38 2022] GET /compute/v2.1/servers/0c118037-44ea-439d-baf5-78bf115ae52a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:37:38.143301 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1095188655", "imageRef": "3320b115-896b-40d5-aa1c-3067ed344e06", "flavorRef": "452", "networks": [{"uuid": "d84b2ca4-6c30-404b-bfc1-a9c501ffffe0"}]}} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:38.195827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.network.neutron [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] validate_networks() for [('d84b2ca4-6c30-404b-bfc1-a9c501ffffe0', None, None, None, None, None)] {{(pid=118425) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:37:38.595385 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Flavor limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:37:38.595872 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Image limits 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:37:38.596383 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Flavor pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:37:38.596798 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Image pref 0:0:0 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:37:38.597214 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.virt.hardware [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118425) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:37:38.606019 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:38.606505 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:38.606939 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:38.607667 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:38.608154 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:38.608580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:38.626853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Getting quotas for project a8deb71dfa2045f2819d87ee669fcc65. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:37:38.630838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.quota [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Getting quotas for user a551273dd0384df392f9c391357f7fbf and project a8deb71dfa2045f2819d87ee669fcc65. Resources: {'ram', 'instances', 'cores'} {{(pid=118425) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:37:38.642764 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Going to run 1 instances... {{(pid=118425) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:37:38.645062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3320b115-896b-40d5-aa1c-3067ed344e06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118425) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:37:38.781846 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f06e0f40-1a8d-4b95-8b2a-bbbced7d989a tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642414 Aug 10 11:37:38.782699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 645/1275] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:37:38.793525 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-809edc58-e2ca-4f21-8637-d264c25f9ff1 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:38.794135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-809edc58-e2ca-4f21-8637-d264c25f9ff1 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:38.850850 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-809edc58-e2ca-4f21-8637-d264c25f9ff1 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:38.858282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-809edc58-e2ca-4f21-8637-d264c25f9ff1 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1214 microversion: 2.1 time: 0.068542 Aug 10 11:37:38.858471 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 631/1276] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:38 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:38.931776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:38.932420 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:38.939061 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:38.939545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:38.939983 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:38.940712 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:38.941166 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:38.941596 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.080039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:39.087641 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ad0fcf37-d8f8-4292-9a17-f268eb7f7435 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.159738 Aug 10 11:37:39.088283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 646/1277] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:38 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:39.879041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:39.879642 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:39.886030 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:39.886504 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:39.886934 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.887605 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:39.888071 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:39.888489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:39.950144 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:39.959210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-903cd21f-e4e9-4ca7-85ed-f159eea93853 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1218 microversion: 2.1 time: 0.084518 Aug 10 11:37:39.959783 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 632/1278] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:39 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:40.109236 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:40.109842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:40.116225 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.116710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.117147 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:40.117834 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.118285 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.118710 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:40.250173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:40.257889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-7643f7dd-4400-4e9d-a6e8-03c35012af0a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.152507 Aug 10 11:37:40.258446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 647/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:40 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:40.781265 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-9087c86c-bd78-44db-85d2-77781a5b1ce7 req-6a510956-d6ef-4d1b-9137-fdfd4ee51f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436b2015-f279-44db-9913-99eac99179bf", "name": "network-vif-plugged", "status": "completed", "tag": "152737fa-7152-4e06-8248-ce310b32d7de"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:40.791187 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9087c86c-bd78-44db-85d2-77781a5b1ce7 req-6a510956-d6ef-4d1b-9137-fdfd4ee51f22 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.791656 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9087c86c-bd78-44db-85d2-77781a5b1ce7 req-6a510956-d6ef-4d1b-9137-fdfd4ee51f22 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.793436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-9087c86c-bd78-44db-85d2-77781a5b1ce7 req-6a510956-d6ef-4d1b-9137-fdfd4ee51f22 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:40.803938 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-9087c86c-bd78-44db-85d2-77781a5b1ce7 req-6a510956-d6ef-4d1b-9137-fdfd4ee51f22 service nova] Creating event network-vif-plugged:152737fa-7152-4e06-8248-ce310b32d7de for instance 436b2015-f279-44db-9913-99eac99179bf on hv-cinder-85061 Aug 10 11:37:40.809129 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-9087c86c-bd78-44db-85d2-77781a5b1ce7 req-6a510956-d6ef-4d1b-9137-fdfd4ee51f22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031661 Aug 10 11:37:40.810051 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 633/1280] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:40.984586 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:40.986788 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:40.995269 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.995753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.996216 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:40.997135 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:40.997584 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:40.998005 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:41.070430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:41.078328 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-eac09f3b-a305-4712-ac1c-7968d0202493 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1284 microversion: 2.1 time: 0.100427 Aug 10 11:37:41.078916 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 648/1281] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:40 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:41.281386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:41.282438 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:41.289239 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:41.289808 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:41.290250 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:41.290950 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:41.291401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:41.291831 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:41.431252 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:41.438976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-cd134f80-931c-4f08-a3b1-6df4d38d4df3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.161900 Aug 10 11:37:41.439547 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 634/1282] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:41 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:42.100225 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:42.100950 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:42.112452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.112452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.112452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.112452 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.113067 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.113067 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.240748 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:42.248812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a33b93b1-fe04-4e31-8378-4ee0a28591db tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.152402 Aug 10 11:37:42.249400 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 649/1283] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:42 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:42.459802 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:42.460440 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:42.467168 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.467679 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.468136 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.469412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.469944 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.474757 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.505019 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-7b32a5bb-9107-4964-929e-5eabe3784347 req-45488356-8806-4866-9066-2e1cb1a18df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c294b09-6fa4-431e-b05d-3603e5de1868", "tag": "6919cd2c-2887-4915-9302-e36f559c1ec9"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:42.515440 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7b32a5bb-9107-4964-929e-5eabe3784347 req-45488356-8806-4866-9066-2e1cb1a18df5 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:42.516185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7b32a5bb-9107-4964-929e-5eabe3784347 req-45488356-8806-4866-9066-2e1cb1a18df5 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:42.517069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-7b32a5bb-9107-4964-929e-5eabe3784347 req-45488356-8806-4866-9066-2e1cb1a18df5 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:42.528363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-7b32a5bb-9107-4964-929e-5eabe3784347 req-45488356-8806-4866-9066-2e1cb1a18df5 service nova] Creating event network-changed:6919cd2c-2887-4915-9302-e36f559c1ec9 for instance 9c294b09-6fa4-431e-b05d-3603e5de1868 on hv-cinder-85061 Aug 10 11:37:42.533894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-7b32a5bb-9107-4964-929e-5eabe3784347 req-45488356-8806-4866-9066-2e1cb1a18df5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032455 Aug 10 11:37:42.534791 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 650/1284] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:42.622868 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:42.631917 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-739106c1-5acb-4904-b343-127fbe4a5724 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1266 microversion: 2.1 time: 0.175947 Aug 10 11:37:42.632531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 635/1285] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:42 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:43.273403 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:43.274040 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:43.281865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.282404 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.282909 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.283618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.284087 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.284692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.420814 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:43.428611 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fa8214fa-fb47-4341-b0c2-c2e95903c6b9 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.160820 Aug 10 11:37:43.429173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 651/1286] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:43 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:43.653015 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:43.653618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:43.660222 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.660699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.663357 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.663357 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.663357 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.663357 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.798139 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:43.805978 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-72c87354-acd9-49e4-89c5-e09ad4f5241d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1454 microversion: 2.1 time: 0.156810 Aug 10 11:37:43.806669 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 636/1287] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:43 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:43.826498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:43.827106 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:43.833194 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.835598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.835598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.835598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:43.835598 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:43.835973 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:43.970449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:43.977958 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5cb0edae-4fcb-48fb-8710-e1039336d4d9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1454 microversion: 2.1 time: 0.155255 Aug 10 11:37:43.978526 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 652/1288] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:43 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:44.449861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:44.450496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:44.457274 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:44.457758 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:44.458195 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:44.458884 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:44.459332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:44.459756 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:44.592566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:44.600817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-3b9a08a7-10f2-46ae-9daf-474dc1d8af53 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.154934 Aug 10 11:37:44.603596 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 637/1289] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:44 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:45.625061 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:45.625866 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:45.632677 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:45.633166 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:45.633599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:45.634299 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:45.634745 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:45.635163 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:45.778023 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:45.786595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b2c5fe58-2706-45cc-8df0-50b181463d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.165767 Aug 10 11:37:45.787431 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 653/1290] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:45 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:46.177584 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-8d849ba2-d477-4775-ad90-a6b0ddc4ff1a req-910e4ca0-55ee-4ad3-917d-0a07cc2726a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "436b2015-f279-44db-9913-99eac99179bf", "tag": "152737fa-7152-4e06-8248-ce310b32d7de"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:46.184360 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:46.188912 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-8d849ba2-d477-4775-ad90-a6b0ddc4ff1a req-910e4ca0-55ee-4ad3-917d-0a07cc2726a7 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:46.189609 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-8d849ba2-d477-4775-ad90-a6b0ddc4ff1a req-910e4ca0-55ee-4ad3-917d-0a07cc2726a7 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:46.190037 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-8d849ba2-d477-4775-ad90-a6b0ddc4ff1a req-910e4ca0-55ee-4ad3-917d-0a07cc2726a7 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:46.201235 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-8d849ba2-d477-4775-ad90-a6b0ddc4ff1a req-910e4ca0-55ee-4ad3-917d-0a07cc2726a7 service nova] Creating event network-changed:152737fa-7152-4e06-8248-ce310b32d7de for instance 436b2015-f279-44db-9913-99eac99179bf on hv-cinder-85061 Aug 10 11:37:46.206696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-8d849ba2-d477-4775-ad90-a6b0ddc4ff1a req-910e4ca0-55ee-4ad3-917d-0a07cc2726a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032676 Aug 10 11:37:46.207660 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 638/1291] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 11:37:46.807574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:46.808342 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:46.816280 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:46.816763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:46.817186 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:46.817979 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:46.818351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:46.818829 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:46.956512 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:46.964232 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-97621229-b205-4ed0-be2b-51d0008534e4 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.160357 Aug 10 11:37:46.965068 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 654/1292] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:46 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:47.987823 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:47.988566 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:47.995295 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:47.995772 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:47.996242 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:47.996918 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:47.997381 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:47.997798 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:48.135725 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:48.143289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b4c13f45-f8f9-4855-b2bf-a8ebb2b5e0bb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.160671 Aug 10 11:37:48.148200 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 639/1293] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:47 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:49.165059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:49.165677 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:49.168104 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:49.168774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=6 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:49.173482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:49.173968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:49.174407 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:49.175098 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:49.175551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:49.175977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:49.307167 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:49.314949 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6f1c354d-f385-45ee-b79e-918097953387 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.153661 Aug 10 11:37:49.315521 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 655/1294] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:49 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:50.336404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:50.337008 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:50.338917 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:50.345536 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:50.346061 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:50.346489 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:50.347172 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:50.347616 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:50.348049 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:50.477471 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:50.484785 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-64a7d103-534e-4f53-9852-7cfa9f3c0b62 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.152372 Aug 10 11:37:50.485370 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 640/1295] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:50 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:50.827482 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-f84bfacf-a6ad-479b-8251-49cb8d4852b7 req-8c6c8617-03ec-451a-9938-aaba2e85557a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c294b09-6fa4-431e-b05d-3603e5de1868", "name": "network-vif-plugged", "status": "completed", "tag": "6919cd2c-2887-4915-9302-e36f559c1ec9"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:50.838632 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f84bfacf-a6ad-479b-8251-49cb8d4852b7 req-8c6c8617-03ec-451a-9938-aaba2e85557a service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:50.839089 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f84bfacf-a6ad-479b-8251-49cb8d4852b7 req-8c6c8617-03ec-451a-9938-aaba2e85557a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:50.839520 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-f84bfacf-a6ad-479b-8251-49cb8d4852b7 req-8c6c8617-03ec-451a-9938-aaba2e85557a service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:50.850841 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-f84bfacf-a6ad-479b-8251-49cb8d4852b7 req-8c6c8617-03ec-451a-9938-aaba2e85557a service nova] Creating event network-vif-plugged:6919cd2c-2887-4915-9302-e36f559c1ec9 for instance 9c294b09-6fa4-431e-b05d-3603e5de1868 on hv-cinder-85061 Aug 10 11:37:50.855840 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-f84bfacf-a6ad-479b-8251-49cb8d4852b7 req-8c6c8617-03ec-451a-9938-aaba2e85557a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032136 Aug 10 11:37:50.856511 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 656/1296] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:51.506059 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:51.506618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:51.513023 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:51.513532 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:51.513965 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:51.514654 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:51.515192 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:51.515630 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:51.645580 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:51.652992 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5d7834ad-c3ad-40bd-bd14-4752aaf31334 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.150949 Aug 10 11:37:51.654167 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 641/1297] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:51 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:52.676152 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:52.676731 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:52.678661 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:37:52.683460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:52.683945 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:52.684415 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:52.685105 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:52.685560 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:52.685986 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:52.815607 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:52.823002 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-fb2483a8-c994-49b1-bc99-55e09657b93c tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1314 microversion: 2.1 time: 0.152181 Aug 10 11:37:52.825498 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 657/1298] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:52 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:53.844171 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:53.844761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:53.852043 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:53.852520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:53.852947 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:53.853626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:53.854069 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:53.854521 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:53.987715 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:53.995713 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f01ae9a8-b8e5-4d43-9d2c-397da6424d51 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1499 microversion: 2.1 time: 0.155571 Aug 10 11:37:53.996332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 642/1299] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:53 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:54.889804 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:54.890429 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:54.896725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:54.897202 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:54.897634 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:54.898313 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:54.898756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:54.899174 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:54.924234 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Going to try to terminate instance {{(pid=118425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:37:55.222809 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-34beb55f-9265-4f6f-92ef-61be93024761 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 204 len: 0 microversion: 2.1 time: 0.336550 Aug 10 11:37:55.223392 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 658/1300] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:37:54 2022] DELETE /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 11:37:55.231552 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:55.232199 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:55.239477 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:55.243209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:55.243209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:55.243209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:55.243209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:55.243666 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:55.369877 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:55.377281 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-ddc7d5a0-468d-49b7-ae69-472bf9bfbbfb tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1505 microversion: 2.1 time: 0.149624 Aug 10 11:37:55.377839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 643/1301] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:55 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:56.398907 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:56.399604 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:56.406158 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:56.406636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:56.407071 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:56.407755 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:56.408242 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:56.408664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:56.543967 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:56.552049 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9ab086fa-9c76-4151-b586-5b5d8c145930 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1505 microversion: 2.1 time: 0.157324 Aug 10 11:37:56.552619 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 659/1302] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:56 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:57.574902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:57.575569 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:57.582639 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:57.583264 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:57.583677 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:57.584299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:57.584692 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:57.585118 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:57.651423 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-90466546-4b21-4de4-9dae-7fe213219e7a req-f8f1b06f-0e56-41b7-b3a4-c0eb39c373d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c294b09-6fa4-431e-b05d-3603e5de1868", "name": "network-vif-deleted", "tag": "6919cd2c-2887-4915-9302-e36f559c1ec9"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:37:57.652101 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a551273dd0384df392f9c391357f7fbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8deb71dfa2045f2819d87ee669fcc65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:37:57.659723 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-baf19cef-8588-41e1-abdf-43d3389e0b93 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 200 len: 1463 microversion: 2.1 time: 0.088895 Aug 10 11:37:57.662659 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 644/1303] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:57 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 1463 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:37:57.662808 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-90466546-4b21-4de4-9dae-7fe213219e7a req-f8f1b06f-0e56-41b7-b3a4-c0eb39c373d4 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:57.663284 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-90466546-4b21-4de4-9dae-7fe213219e7a req-f8f1b06f-0e56-41b7-b3a4-c0eb39c373d4 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:57.663722 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-90466546-4b21-4de4-9dae-7fe213219e7a req-f8f1b06f-0e56-41b7-b3a4-c0eb39c373d4 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:57.675217 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-90466546-4b21-4de4-9dae-7fe213219e7a req-f8f1b06f-0e56-41b7-b3a4-c0eb39c373d4 service nova] Creating event network-vif-deleted:6919cd2c-2887-4915-9302-e36f559c1ec9 for instance 9c294b09-6fa4-431e-b05d-3603e5de1868 on hv-cinder-85061 Aug 10 11:37:57.680159 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-90466546-4b21-4de4-9dae-7fe213219e7a req-f8f1b06f-0e56-41b7-b3a4-c0eb39c373d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033513 Aug 10 11:37:57.680954 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 660/1304] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:37:58.680498 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:37:58.681176 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] [instance: 9c294b09-6fa4-431e-b05d-3603e5de1868] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:37:58.688282 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.688771 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.689208 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.689897 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:37:58.690358 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:37:58.690784 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:37:58.704461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] HTTP exception thrown: Instance 9c294b09-6fa4-431e-b05d-3603e5de1868 could not be found. Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Request method failure captured: Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 HTTP/1.1 Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85hoLVlOdnODFBBuBvFXi4REBU3FzphJzSe2g24soylOMU76t52IlV_cVN1I_I8exUOLRBpi9Gxar_j8M15kX0gFlQ_5-unV73Iilsk7qEeV3qUa-UCa6N90MwqX8zGvvCqOdUz3_EJro2OP1dbmLD48XawjuwLxMiw_8Do2HXJOJ-I Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: a8deb71dfa2045f2819d87ee669fcc65 Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-VolumesActionsTest-395806551 Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:37:58.706108 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8deb71dfa2045f2819d87ee669fcc65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a8deb71dfa2045f2819d87ee669fcc65"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a8deb71dfa2045f2819d87ee669fcc65"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a8deb71dfa2045f2819d87ee669fcc65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-VolumesActionsTest-395806551 Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: a8deb71dfa2045f2819d87ee669fcc65 Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-VolumesActionsTest-395806551 Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-VolumesActionsTest-395806551-project Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: a551273dd0384df392f9c391357f7fbf Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-VolumesActionsTest-395806551-project Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 9c294b09-6fa4-431e-b05d-3603e5de1868 could not be found. Aug 10 11:37:58.707900 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '9c294b09-6fa4-431e-b05d-3603e5de1868'} Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c294b09-6fa4-431e-b05d-3603e5de1868 could not be found. Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:37:58.708895 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c294b09-6fa4-431e-b05d-3603e5de1868 could not be found. Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c294b09-6fa4-431e-b05d-3603e5de1868 could not be found. Aug 10 11:37:58.710463 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:37:58.711750 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] Returning 404 to user: Instance 9c294b09-6fa4-431e-b05d-3603e5de1868 could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:37:58.711750 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-9716bae1-378c-438d-8517-fbbc3f42d464 tempest-VolumesActionsTest-395806551 tempest-VolumesActionsTest-395806551-project] 10.222.0.13 "GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868" status: 404 len: 111 microversion: 2.1 time: 0.030989 Aug 10 11:37:58.712240 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 645/1305] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:37:58 2022] GET /compute/v2.1/servers/9c294b09-6fa4-431e-b05d-3603e5de1868 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:39:21.893415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:39:21.894095 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Wed Aug 10 11:39:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:40:04.103575 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22f9a555-083c-417c-90f7-3503227a9591] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 11:40:04.104529 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:04.105270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:04.109349 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:04.109936 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:04.115900 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:04.129191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:04.129191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:04.129191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:04.129191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:04.129612 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:04.143873 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Going to try to terminate instance {{(pid=118425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:40:04.488370 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-91cd6fa2-9964-4eeb-b0c3-9d6ba058bd1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "DELETE /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 204 len: 0 microversion: 2.1 time: 0.386480 Aug 10 11:40:04.488955 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 661/1306] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:40:04 2022] DELETE /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:40:04.495138 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a9d70ab4-d8d0-4c81-a203-0f45d548c6df] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 11:40:04.495699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=15 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:04.496452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=74 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:04.501074 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:04.501678 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:04.507427 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:04.507905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:04.508382 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:04.509068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:04.509515 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:04.509936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:04.643837 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:04.651373 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a9bc9c95-8c39-4dc3-ab74-59797b4f0288 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1578 microversion: 2.1 time: 0.158095 Aug 10 11:40:04.651932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 646/1307] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:04 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:05.674250 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:05.674868 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:05.682366 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:05.682849 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:05.683282 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:05.683964 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:05.684444 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:05.685806 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:05.690962 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] [22f9a555-083c-417c-90f7-3503227a9591] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55520. Aug 10 11:40:05.817275 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:05.824968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-5386b15c-5c4e-4ccc-831c-78e20ef2faf9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1578 microversion: 2.1 time: 0.155641 Aug 10 11:40:05.830423 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 662/1308] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:05 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:06.846932 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:06.847549 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:06.859688 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [-] [a9d70ab4-d8d0-4c81-a203-0f45d548c6df] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55524. Aug 10 11:40:06.863768 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:06.864279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:06.864716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:06.865415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:06.865861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:06.866297 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:07.007119 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:07.015266 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-465fc741-e6ba-4eca-820c-4683ba6a3d1e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1578 microversion: 2.1 time: 0.172174 Aug 10 11:40:07.015827 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 647/1309] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:06 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:07.537149 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-8d1d5fbc-3e2c-49e8-b625-bf24db03a240 req-0a3eb3c0-f44a-45d7-8d9c-20d24ce2fe1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436b2015-f279-44db-9913-99eac99179bf", "name": "network-vif-deleted", "tag": "152737fa-7152-4e06-8248-ce310b32d7de"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:07.547576 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-8d1d5fbc-3e2c-49e8-b625-bf24db03a240 req-0a3eb3c0-f44a-45d7-8d9c-20d24ce2fe1d service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:07.548083 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-8d1d5fbc-3e2c-49e8-b625-bf24db03a240 req-0a3eb3c0-f44a-45d7-8d9c-20d24ce2fe1d service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:07.548529 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-8d1d5fbc-3e2c-49e8-b625-bf24db03a240 req-0a3eb3c0-f44a-45d7-8d9c-20d24ce2fe1d service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:07.560942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-8d1d5fbc-3e2c-49e8-b625-bf24db03a240 req-0a3eb3c0-f44a-45d7-8d9c-20d24ce2fe1d service nova] Creating event network-vif-deleted:152737fa-7152-4e06-8248-ce310b32d7de for instance 436b2015-f279-44db-9913-99eac99179bf on hv-cinder-85061 Aug 10 11:40:07.566273 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-8d1d5fbc-3e2c-49e8-b625-bf24db03a240 req-0a3eb3c0-f44a-45d7-8d9c-20d24ce2fe1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178788 Aug 10 11:40:07.566875 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 663/1310] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:08.035365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:08.036114 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:08.042560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:08.043039 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:08.043476 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:08.044691 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:08.045414 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:08.045713 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:08.109446 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:08.117878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-be477f67-bc46-468c-823c-48bba6c978bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 200 len: 1225 microversion: 2.1 time: 0.086322 Aug 10 11:40:08.118570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 648/1311] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:08 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:09.141206 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:09.141853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:09.147956 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:09.148470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:09.148908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:09.149593 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:09.150046 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:09.150470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:09.163966 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] HTTP exception thrown: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Request method failure captured: Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf HTTP/1.1 Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85hOwvmxVhcGa4qzC8lfbcOjbuRtVqDwFwDmKgLYC_amuXrpCjV4XyGK-j9HapFZlwQtxBhqcG2S4MhfcE4XIrj1BfPM_Zt5OAhDNBQjXRU5UavI2VmzX_DmBAg_Q91y9_iYuW5RIcXeBtiiT2Vz_Bjqux09EJJiMlpK4PYb5RmmjYA Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:40:09.165603 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-TestVolumeBootPattern-298050020 Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 63e9c06c2c4f4caabf6ecd67cece94f4 Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:40:09.167389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '436b2015-f279-44db-9913-99eac99179bf'} Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:40:09.168644 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:40:09.170538 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:40:09.172078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Returning 404 to user: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:40:09.172078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-61f5c3a3-772b-428a-ab55-93cd2f687edd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 404 len: 111 microversion: 2.1 time: 0.031113 Aug 10 11:40:09.172078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 664/1312] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:09 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:40:09.264075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-887565191", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1626919928", "security_groups": [{"name": "tempest-secgroup-smoke-1086611563"}], "block_device_mapping_v2": [{"uuid": "e79c9c20-7089-47fe-b6ea-9e5cc3b72dac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd56801a-9245-407d-8810-39f61a13c5db"}]}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:09.378567 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] validate_networks() for [('fd56801a-9245-407d-8810-39f61a13c5db', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:40:09.993415 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:40:09.993840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:40:09.994322 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:40:09.994730 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:40:09.995142 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:40:10.004104 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:10.004587 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:10.005029 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:10.005754 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:10.006203 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:10.006628 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:10.022962 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Getting quotas for project e8775e002af14ee2ac9d6601a6872dfa. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:40:10.026928 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Getting quotas for user 63e9c06c2c4f4caabf6ecd67cece94f4 and project e8775e002af14ee2ac9d6601a6872dfa. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:40:10.083507 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:40:10.085589 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e79c9c20-7089-47fe-b6ea-9e5cc3b72dac',volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:40:10.576621 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-82b5eefb-e4b6-473a-880b-98ab972c3a0e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.316010 Aug 10 11:40:10.577388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 649/1313] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:40:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 11:40:10.588032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-70a6cf28-7a3a-42e8-8209-1818f07bf65e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:10.589574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-70a6cf28-7a3a-42e8-8209-1818f07bf65e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:10.648899 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-70a6cf28-7a3a-42e8-8209-1818f07bf65e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:10.657163 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-70a6cf28-7a3a-42e8-8209-1818f07bf65e tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1094 microversion: 2.1 time: 0.073033 Aug 10 11:40:10.657714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 665/1314] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:10 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:11.677418 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:11.678041 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:11.684272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:11.684904 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:11.685347 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:11.686084 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:11.686532 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:11.686956 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:11.747191 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:11.754629 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-063f08e5-61b7-41c8-bad6-d8536a8832de tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1144 microversion: 2.1 time: 0.081628 Aug 10 11:40:11.755192 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 650/1315] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:11 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:12.776019 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:12.776633 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:12.783400 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:12.783889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:12.784400 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:12.785120 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:12.785573 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:12.785996 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:12.850618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:12.857968 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-749b0f54-81e0-44a7-8074-9e5a9d5531e9 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1200 microversion: 2.1 time: 0.085888 Aug 10 11:40:12.858536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 666/1316] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:12 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:13.878812 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:13.879426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:13.886426 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:13.890143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:13.890143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:13.890143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:13.890143 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:13.890486 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:14.023048 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:14.031485 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-dd7c27d9-f57d-4ab8-ae7c-ce7a40274951 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1278 microversion: 2.1 time: 0.156564 Aug 10 11:40:14.032089 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 651/1317] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:13 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:14.266464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-64fe459e-7021-4324-a802-a6607d02f4ea req-b0db6790-5304-4dc5-aeec-c92d84fa47b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fd7e13-e433-48a7-acbb-ab0b9c71c750", "tag": "9fa0ea15-40a4-497c-89a3-e9355dd0a419"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:14.276386 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-64fe459e-7021-4324-a802-a6607d02f4ea req-b0db6790-5304-4dc5-aeec-c92d84fa47b9 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:14.282191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-64fe459e-7021-4324-a802-a6607d02f4ea req-b0db6790-5304-4dc5-aeec-c92d84fa47b9 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:14.282191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-64fe459e-7021-4324-a802-a6607d02f4ea req-b0db6790-5304-4dc5-aeec-c92d84fa47b9 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:14.290831 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-64fe459e-7021-4324-a802-a6607d02f4ea req-b0db6790-5304-4dc5-aeec-c92d84fa47b9 service nova] Creating event network-changed:9fa0ea15-40a4-497c-89a3-e9355dd0a419 for instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 on hv-cinder-85061 Aug 10 11:40:14.296471 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-64fe459e-7021-4324-a802-a6607d02f4ea req-b0db6790-5304-4dc5-aeec-c92d84fa47b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034608 Aug 10 11:40:14.297424 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 667/1318] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:15.052763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:15.053356 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:15.059735 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:15.060262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:15.060699 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:15.061388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:15.061835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:15.062259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:15.194279 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:15.201840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-4639e418-e3d1-4207-a7cb-a3dd61fb820b tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.152944 Aug 10 11:40:15.202408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 652/1319] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:15 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:16.223692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:16.224416 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:16.230470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:16.230947 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:16.232057 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:16.232684 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:16.233131 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:16.233553 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:16.363580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:16.371308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-4af5fe23-8306-48a4-9fa2-8f62cc1f8f32 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.152222 Aug 10 11:40:16.372016 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 668/1320] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:16 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:17.392814 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:17.393423 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:17.399861 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:17.400372 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:17.400805 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:17.401492 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:17.401940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:17.402359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:17.543626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:17.544555 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8ec1768b-2970-4d5a-9d09-556dbd00d5a4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.154802 Aug 10 11:40:17.545140 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 653/1321] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:17 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:18.565460 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:18.566070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:18.572449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:18.572934 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:18.573372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:18.574161 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:18.574610 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:18.575231 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:18.711372 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:18.719121 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-52dd52c7-4562-46a2-a15e-54d87805959f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.157500 Aug 10 11:40:18.719702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 669/1322] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:18 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:19.740288 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:19.740897 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:19.747440 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:19.747930 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:19.748398 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:19.749081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:19.749532 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:19.749953 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:19.882163 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:19.889622 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-28ec9b06-56d8-438d-ad7e-44dd7ecf21bc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.153235 Aug 10 11:40:19.890184 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 654/1323] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:19 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:20.909642 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:20.910248 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:20.912725 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=2 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:20.917446 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:20.917930 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:20.918362 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:20.919601 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:20.920125 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:20.920555 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:21.052171 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:21.059618 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-59e98702-8752-4e87-aaf8-3d0048b5b7b4 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.153754 Aug 10 11:40:21.060199 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 670/1324] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:20 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:22.080592 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:22.081204 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:22.083056 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:22.083705 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=6 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:40:22.088922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:22.089401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:22.089835 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:22.090517 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:22.091259 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:22.091553 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:22.223907 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:22.232088 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-f218f2e0-5600-4b47-a166-b52e2989f451 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.154658 Aug 10 11:40:22.232856 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 655/1325] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:22 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:23.252859 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:23.253464 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:23.260059 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:23.260545 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:23.260978 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:23.261670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:23.262151 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:23.263093 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:23.402191 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:23.410069 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f0aa6ea0-e474-49be-9a76-06a9f128fc67 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.161158 Aug 10 11:40:23.423333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 671/1326] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:23 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:24.430781 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:24.431387 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:24.438643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:24.439123 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:24.439560 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:24.440262 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:24.440714 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:24.441142 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:24.570546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:24.578189 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2e7d7bb2-8c74-4813-b835-f8e27cedb1f1 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.151333 Aug 10 11:40:24.578759 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 656/1327] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:24 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:24.890474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-297f6735-2423-4cd2-8523-452e66ae5411 req-f9e602fb-3f05-44d1-87ec-13f776d41948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fd7e13-e433-48a7-acbb-ab0b9c71c750", "name": "network-vif-plugged", "status": "completed", "tag": "9fa0ea15-40a4-497c-89a3-e9355dd0a419"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:24.900347 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-297f6735-2423-4cd2-8523-452e66ae5411 req-f9e602fb-3f05-44d1-87ec-13f776d41948 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:24.900868 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-297f6735-2423-4cd2-8523-452e66ae5411 req-f9e602fb-3f05-44d1-87ec-13f776d41948 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:24.901319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-297f6735-2423-4cd2-8523-452e66ae5411 req-f9e602fb-3f05-44d1-87ec-13f776d41948 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:24.912698 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-297f6735-2423-4cd2-8523-452e66ae5411 req-f9e602fb-3f05-44d1-87ec-13f776d41948 service nova] Creating event network-vif-plugged:9fa0ea15-40a4-497c-89a3-e9355dd0a419 for instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 on hv-cinder-85061 Aug 10 11:40:24.917559 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-297f6735-2423-4cd2-8523-452e66ae5411 req-f9e602fb-3f05-44d1-87ec-13f776d41948 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031162 Aug 10 11:40:24.918363 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 672/1328] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:40:25.598922 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:25.599530 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:25.606022 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:25.606520 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:25.606948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:25.607626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:25.608120 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:25.608542 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:25.754386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:25.763225 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-11655bbc-7a49-494d-828a-3dead6caee37 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1266 microversion: 2.1 time: 0.167397 Aug 10 11:40:25.764294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 657/1329] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:25 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:26.794290 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:26.794980 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:26.801118 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:26.801600 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:26.802034 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:26.802724 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:26.803173 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:26.803599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:26.936443 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:26.943913 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-d7a7c392-72bc-49b4-81b4-16b30a07126d tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1453 microversion: 2.1 time: 0.154430 Aug 10 11:40:26.944575 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 673/1330] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:26 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:26.964299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:40:26.964929 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:40:26.972658 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:26.973129 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:26.973557 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:26.974291 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:26.974733 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:26.975207 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:27.106526 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:40:27.114371 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-aed7a0c4-bf71-455a-b9e4-b8e62a52c935 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1453 microversion: 2.1 time: 0.153933 Aug 10 11:40:27.114966 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 658/1331] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:40:26 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:40:29.207329 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-5d086f91-643b-4ca3-863a-017ece2a3e89 req-4b2ba3ac-8606-49cd-9690-8c2996d53cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fd7e13-e433-48a7-acbb-ab0b9c71c750", "tag": "9fa0ea15-40a4-497c-89a3-e9355dd0a419"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:40:29.218223 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-5d086f91-643b-4ca3-863a-017ece2a3e89 req-4b2ba3ac-8606-49cd-9690-8c2996d53cfc service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:40:29.218699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-5d086f91-643b-4ca3-863a-017ece2a3e89 req-4b2ba3ac-8606-49cd-9690-8c2996d53cfc service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:40:29.219125 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-5d086f91-643b-4ca3-863a-017ece2a3e89 req-4b2ba3ac-8606-49cd-9690-8c2996d53cfc service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:40:29.233689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-5d086f91-643b-4ca3-863a-017ece2a3e89 req-4b2ba3ac-8606-49cd-9690-8c2996d53cfc service nova] Creating event network-changed:9fa0ea15-40a4-497c-89a3-e9355dd0a419 for instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 on hv-cinder-85061 Aug 10 11:40:29.238523 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-5d086f91-643b-4ca3-863a-017ece2a3e89 req-4b2ba3ac-8606-49cd-9690-8c2996d53cfc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088157 Aug 10 11:40:29.239169 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 674/1332] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:30.766319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:30.767065 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=74 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:30.771029 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1362432069", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1626919928", "security_groups": [{"name": "tempest-secgroup-smoke-1086611563"}], "block_device_mapping_v2": [{"uuid": "bf40a06e-a008-4030-93d4-f1ae5c52ac3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fd56801a-9245-407d-8810-39f61a13c5db"}]}} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:30.965277 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.network.neutron [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] validate_networks() for [('fd56801a-9245-407d-8810-39f61a13c5db', None, None, None, None, None)] {{(pid=118426) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 11:42:31.409455 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Flavor limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 11:42:31.409881 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Image limits 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 11:42:31.410384 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Flavor pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 11:42:31.410794 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Image pref 0:0:0 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 11:42:31.411206 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.virt.hardware [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118426) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 11:42:31.420767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:31.421249 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:31.421685 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:31.422436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:31.422889 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:31.423315 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:31.440738 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Getting quotas for project e8775e002af14ee2ac9d6601a6872dfa. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 11:42:31.444507 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.quota [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Getting quotas for user 63e9c06c2c4f4caabf6ecd67cece94f4 and project e8775e002af14ee2ac9d6601a6872dfa. Resources: {'ram', 'instances', 'cores'} {{(pid=118426) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 11:42:31.501095 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Going to run 1 instances... {{(pid=118426) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 11:42:31.503095 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bf40a06e-a008-4030-93d4-f1ae5c52ac3b',volume_size=None,volume_type=None)] {{(pid=118426) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 11:42:31.977807 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [2fb0bfc5-ab91-4f19-8b68-04c899a19741] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 11:42:32.985261 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [2fb0bfc5-ab91-4f19-8b68-04c899a19741] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55692. Aug 10 11:42:32.989046 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-0bb99693-d664-46c0-8c82-4ee363088286 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.224396 Aug 10 11:42:32.989763 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 659/1333] 10.222.0.13 () {60 vars in 1147 bytes} [Wed Aug 10 11:42:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 2226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 11:42:32.998965 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22f9a555-083c-417c-90f7-3503227a9591] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 11:42:32.999597 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:33.000369 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:33.004714 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a231024c-4ba1-4870-ae01-3a6f5066c24c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:33.005908 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a231024c-4ba1-4870-ae01-3a6f5066c24c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:33.111032 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a231024c-4ba1-4870-ae01-3a6f5066c24c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:33.115562 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a231024c-4ba1-4870-ae01-3a6f5066c24c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1095 microversion: 2.1 time: 0.118477 Aug 10 11:42:33.116140 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 675/1334] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:32 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1095 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:34.136439 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-409db334-bf9a-4c05-b2a9-add6e69bd778 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:34.137126 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-409db334-bf9a-4c05-b2a9-add6e69bd778 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:34.190197 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-409db334-bf9a-4c05-b2a9-add6e69bd778 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:34.196846 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-409db334-bf9a-4c05-b2a9-add6e69bd778 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1095 microversion: 2.1 time: 0.065027 Aug 10 11:42:34.197405 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 660/1335] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:34 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:35.217565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-faf72b0e-e77f-41d0-8d83-7359745b2159 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:35.218177 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-faf72b0e-e77f-41d0-8d83-7359745b2159 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:35.230432 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] [22f9a555-083c-417c-90f7-3503227a9591] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55716. Aug 10 11:42:35.275692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-faf72b0e-e77f-41d0-8d83-7359745b2159 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:35.282318 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-faf72b0e-e77f-41d0-8d83-7359745b2159 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1095 microversion: 2.1 time: 0.069163 Aug 10 11:42:35.282876 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 676/1336] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:35 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:36.302695 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d09e7741-cbef-4cd7-8152-1cdcae5455d0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:36.303306 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-d09e7741-cbef-4cd7-8152-1cdcae5455d0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:36.358809 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-d09e7741-cbef-4cd7-8152-1cdcae5455d0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:36.365495 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d09e7741-cbef-4cd7-8152-1cdcae5455d0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1095 microversion: 2.1 time: 0.066741 Aug 10 11:42:36.366054 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 661/1337] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:36 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:37.387767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:37.388405 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:37.395076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:37.395565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:37.396026 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:37.396708 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:37.397156 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:37.397580 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:37.457516 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:37.465078 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-c95a9d5a-d477-44b8-9a51-1e31ac806379 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1145 microversion: 2.1 time: 0.081937 Aug 10 11:42:37.465643 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 677/1338] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:37 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:38.486296 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:38.486905 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:38.493496 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:38.500075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:38.500075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:38.500075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:38.500075 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:38.500525 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:38.557319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:38.564896 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-88007f0d-d6a9-4510-af53-84fc054c6e98 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1137 microversion: 2.1 time: 0.082860 Aug 10 11:42:38.565464 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 662/1339] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:38 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:39.376264 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:42:39.376740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:42:39.586308 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:39.586918 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:39.594926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:39.594926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:39.594926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:39.595591 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:39.600155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:39.600155 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:39.661253 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:39.669162 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8b9f7bde-7cf3-47fb-a440-55656fb64ae2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1211 microversion: 2.1 time: 0.086776 Aug 10 11:42:39.669737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 678/1340] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:39 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:40.692055 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:40.692656 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:40.699913 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:40.700461 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:40.701929 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:40.702678 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:40.703157 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:40.703597 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:40.848401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:40.856243 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-c41ac92d-79f9-4bad-aa23-ffec8d5149f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1279 microversion: 2.1 time: 0.168356 Aug 10 11:42:40.856817 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 663/1341] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:40 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:41.032802 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-fe4087be-f8e3-4149-b1ae-fcacef61edff req-1cee81ed-ad19-40c2-9546-be3681f024f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b61bca4-80e0-498d-9c13-754349e9675d", "tag": "e008a203-743c-469d-8c02-1ad5651ae3fd"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:41.045322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-fe4087be-f8e3-4149-b1ae-fcacef61edff req-1cee81ed-ad19-40c2-9546-be3681f024f7 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:41.045797 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-fe4087be-f8e3-4149-b1ae-fcacef61edff req-1cee81ed-ad19-40c2-9546-be3681f024f7 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:41.046227 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-fe4087be-f8e3-4149-b1ae-fcacef61edff req-1cee81ed-ad19-40c2-9546-be3681f024f7 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:41.058892 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-fe4087be-f8e3-4149-b1ae-fcacef61edff req-1cee81ed-ad19-40c2-9546-be3681f024f7 service nova] Creating event network-changed:e008a203-743c-469d-8c02-1ad5651ae3fd for instance 4b61bca4-80e0-498d-9c13-754349e9675d on hv-cinder-85061 Aug 10 11:42:41.064219 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-fe4087be-f8e3-4149-b1ae-fcacef61edff req-1cee81ed-ad19-40c2-9546-be3681f024f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035776 Aug 10 11:42:41.065728 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 679/1342] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:41.876700 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:41.877307 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:41.879133 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=2 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:41.884362 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:41.884845 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:41.885948 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:41.886293 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:41.886741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:41.887165 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:41.903761 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:42:41.903981 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Wed Aug 10 11:42:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d (ip 10.222.0.13) !!! Aug 10 11:42:42.029173 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:42.036716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-eed55269-40ad-479d-9350-583eb507c8dc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.163969 Aug 10 11:42:42.037324 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 664/1343] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:41 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:43.063046 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:43.063659 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:43.070740 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:43.071030 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:43.071458 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:43.072172 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:43.072734 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:43.073322 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:43.206099 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:43.214104 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-a70855f5-83a7-48da-991c-c5739d812ae0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.154820 Aug 10 11:42:43.214663 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 680/1344] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:43 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:44.234665 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:44.235270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:44.241661 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:44.242135 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:44.242565 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:44.243255 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:44.243694 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:44.244136 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:44.375971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:44.383354 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a635c6c2-bd91-4124-8738-d9cbcb6f64c0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.152545 Aug 10 11:42:44.383936 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 665/1345] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:44 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:44.472493 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:42:44.472974 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:42:45.403820 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:45.409886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:45.409886 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell0:SELECT=4 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:45.411564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:45.412077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:45.412518 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:45.413206 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:45.413659 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:45.414084 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:45.548737 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:45.556189 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-59a01553-0902-44b2-989d-51149a88e3ad tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.156176 Aug 10 11:42:45.556756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 681/1346] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:45 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:46.576332 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:46.576940 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:46.579299 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell0:SELECT=10 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:42:46.584080 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:46.584561 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:46.584993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:46.585677 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:46.586124 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:46.586546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:46.726341 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:46.733976 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-8d588c2c-0130-4fd7-977b-34e4b2bb95a6 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.161794 Aug 10 11:42:46.734543 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 666/1347] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:46 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:47.754492 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:47.755168 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:47.762226 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:47.762716 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:47.763149 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:47.763842 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:47.764336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:47.764767 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:47.894595 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:47.902231 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-b5734d6a-024b-4395-94eb-2d58e17d19cc tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.151703 Aug 10 11:42:47.902794 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 682/1348] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:47 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:48.922695 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:48.923303 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:48.930502 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:48.930979 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:48.931401 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:48.932644 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:48.933092 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:48.933509 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:49.064883 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:49.072289 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-aecda7f1-4693-4913-b692-af331353b3c2 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.153510 Aug 10 11:42:49.073361 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 667/1349] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:48 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:50.093076 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:50.093687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:50.100336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:50.100819 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:50.101253 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:50.101938 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:50.102389 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:50.102812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:50.236246 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:50.243670 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f4522266-2d79-49fe-a91e-9c2b83f465bf tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.154414 Aug 10 11:42:50.244261 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 683/1350] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:50 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:51.265386 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:51.265995 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:51.272701 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:51.273180 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:51.273611 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:51.274294 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:51.274741 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:51.275169 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:51.414097 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:51.422213 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-a86f19d5-1de3-42c1-a13e-47eebd26434a tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.160630 Aug 10 11:42:51.422902 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 668/1351] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:51 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:52.442853 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:52.443459 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:52.450077 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:52.450559 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:52.450990 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:52.451702 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:52.452183 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:52.452609 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:52.584410 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:52.592774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-8d282722-22e5-4a91-abfe-e76f3ec6d8ab tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.153731 Aug 10 11:42:52.593336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 684/1352] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:52 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:53.579321 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-3899150d-85fb-4f9b-bc3a-eb8b2599e9c6 req-b7749bce-eb3b-407e-b47e-4e71b178af65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b61bca4-80e0-498d-9c13-754349e9675d", "name": "network-vif-plugged", "status": "completed", "tag": "e008a203-743c-469d-8c02-1ad5651ae3fd"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:53.588683 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-3899150d-85fb-4f9b-bc3a-eb8b2599e9c6 req-b7749bce-eb3b-407e-b47e-4e71b178af65 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:53.589150 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-3899150d-85fb-4f9b-bc3a-eb8b2599e9c6 req-b7749bce-eb3b-407e-b47e-4e71b178af65 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:53.589570 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-3899150d-85fb-4f9b-bc3a-eb8b2599e9c6 req-b7749bce-eb3b-407e-b47e-4e71b178af65 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:53.600546 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-3899150d-85fb-4f9b-bc3a-eb8b2599e9c6 req-b7749bce-eb3b-407e-b47e-4e71b178af65 service nova] Creating event network-vif-plugged:e008a203-743c-469d-8c02-1ad5651ae3fd for instance 4b61bca4-80e0-498d-9c13-754349e9675d on hv-cinder-85061 Aug 10 11:42:53.604459 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR oslo.messaging._drivers.impl_rabbit [req-3899150d-85fb-4f9b-bc3a-eb8b2599e9c6 req-b7749bce-eb3b-407e-b47e-4e71b178af65 service nova] [79d95755-43e0-444a-8e82-210b3ecf9ee3] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 11:42:53.614925 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:53.615666 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:53.622775 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:53.623260 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:53.623692 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:53.624403 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:53.624852 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:53.625270 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:53.760067 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:53.767766 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9c1cef1c-5f74-491e-8f79-7fc727b2b95c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.157464 Aug 10 11:42:53.768364 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 685/1353] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:53 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:42:54.611442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [req-3899150d-85fb-4f9b-bc3a-eb8b2599e9c6 req-b7749bce-eb3b-407e-b47e-4e71b178af65 service nova] [79d95755-43e0-444a-8e82-210b3ecf9ee3] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55774. Aug 10 11:42:54.615081 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-3899150d-85fb-4f9b-bc3a-eb8b2599e9c6 req-b7749bce-eb3b-407e-b47e-4e71b178af65 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.096138 Aug 10 11:42:54.615687 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 669/1354] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:42:54.789319 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:54.790014 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:54.796865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:54.797430 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:54.797943 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:54.798735 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:54.799255 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:54.799687 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:54.941776 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:54.950635 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-cf889a4f-149e-43f2-ab37-860f8d8a6963 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.164821 Aug 10 11:42:54.951195 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 686/1355] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:54 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:55.974673 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:55.975365 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:55.981971 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:55.982449 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:55.982876 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:55.983554 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:55.984016 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:55.984442 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:56.114508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:56.122604 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-780aab60-76f4-49e9-a78b-3a948adbc77f tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1267 microversion: 2.1 time: 0.152840 Aug 10 11:42:56.123173 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 670/1356] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:55 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:57.144828 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:57.145425 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:57.152926 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:57.153413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:57.153851 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:57.154540 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:57.154991 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:57.155413 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:57.289205 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:57.296745 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-59af3149-5ce7-4b1f-ac46-1798173563b3 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1454 microversion: 2.1 time: 0.155728 Aug 10 11:42:57.297309 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 687/1357] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:57 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:57.316202 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:42:57.316840 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:42:57.323760 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:57.324280 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:57.324716 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:57.325404 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:57.325851 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:57.326272 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:57.459276 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:42:57.467704 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-b1036e85-0630-4b16-8973-53ab236dd956 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1454 microversion: 2.1 time: 0.155416 Aug 10 11:42:57.468301 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 671/1358] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:42:57 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:42:59.829470 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-3e395b5c-b523-477d-9a4b-5bbc1cdc57bc req-6f603921-68d8-45d7-bdb7-aae3efb187e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b61bca4-80e0-498d-9c13-754349e9675d", "tag": "e008a203-743c-469d-8c02-1ad5651ae3fd"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:42:59.838664 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3e395b5c-b523-477d-9a4b-5bbc1cdc57bc req-6f603921-68d8-45d7-bdb7-aae3efb187e3 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:42:59.840699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3e395b5c-b523-477d-9a4b-5bbc1cdc57bc req-6f603921-68d8-45d7-bdb7-aae3efb187e3 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:42:59.840699 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-3e395b5c-b523-477d-9a4b-5bbc1cdc57bc req-6f603921-68d8-45d7-bdb7-aae3efb187e3 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:42:59.851393 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-3e395b5c-b523-477d-9a4b-5bbc1cdc57bc req-6f603921-68d8-45d7-bdb7-aae3efb187e3 service nova] Creating event network-changed:e008a203-743c-469d-8c02-1ad5651ae3fd for instance 4b61bca4-80e0-498d-9c13-754349e9675d on hv-cinder-85061 Aug 10 11:42:59.857008 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-3e395b5c-b523-477d-9a4b-5bbc1cdc57bc req-6f603921-68d8-45d7-bdb7-aae3efb187e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Aug 10 11:42:59.857599 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 688/1359] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:51.329388 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:51.330764 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG dbcounter [-] [118426] Writing DB stats nova_cell1:SELECT=58 {{(pid=118426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:51.332936 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR oslo.messaging._drivers.impl_rabbit [-] [22f9a555-083c-417c-90f7-3503227a9591] AMQP server on 10.222.0.13:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 11:44:51.333625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_api:SELECT=32 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:51.334582 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG dbcounter [-] [118425] Writing DB stats nova_cell1:SELECT=64 {{(pid=118425) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 11:44:51.335038 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:51.335620 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:51.338977 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [req-6e220887-a8d5-4efc-b79d-ff69a8f54b22 req-5dc65812-deb1-4cbe-b8a1-1fda208dad27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b61bca4-80e0-498d-9c13-754349e9675d", "tag": "e008a203-743c-469d-8c02-1ad5651ae3fd"}]} {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:51.341849 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:51.342408 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:51.342764 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:51.343454 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:51.344074 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:51.344508 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:51.349860 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-6e220887-a8d5-4efc-b79d-ff69a8f54b22 req-5dc65812-deb1-4cbe-b8a1-1fda208dad27 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:51.350321 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-6e220887-a8d5-4efc-b79d-ff69a8f54b22 req-5dc65812-deb1-4cbe-b8a1-1fda208dad27 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:51.350753 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [req-6e220887-a8d5-4efc-b79d-ff69a8f54b22 req-5dc65812-deb1-4cbe-b8a1-1fda208dad27 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:51.362264 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.compute.server_external_events [req-6e220887-a8d5-4efc-b79d-ff69a8f54b22 req-5dc65812-deb1-4cbe-b8a1-1fda208dad27 service nova] Creating event network-changed:e008a203-743c-469d-8c02-1ad5651ae3fd for instance 4b61bca4-80e0-498d-9c13-754349e9675d on hv-cinder-85061 Aug 10 11:44:51.368564 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [req-6e220887-a8d5-4efc-b79d-ff69a8f54b22 req-5dc65812-deb1-4cbe-b8a1-1fda208dad27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038902 Aug 10 11:44:51.369179 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 689/1360] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:51.375664 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Going to try to terminate instance {{(pid=118426) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:44:51.627690 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-df8ceff1-5edd-4720-b7d6-f538a04ac8f0 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 204 len: 0 microversion: 2.1 time: 0.300114 Aug 10 11:44:51.631697 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 672/1361] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:44:51 2022] DELETE /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:44:51.638012 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:51.638745 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:51.645817 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:51.649581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:51.649581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:51.649581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:51.649581 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:51.649991 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:51.794636 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:51.802303 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-e67bf788-214a-4644-aab0-b6bbb22061dd tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1579 microversion: 2.1 time: 0.169070 Aug 10 11:44:51.807183 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 690/1362] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:51 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:52.825758 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:52.826591 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:52.833395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:52.833875 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:52.834312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:52.835003 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:52.835453 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:52.835875 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:52.973751 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:52.981836 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-7a4c9811-f957-4983-b979-f316753d6ede tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1579 microversion: 2.1 time: 0.161098 Aug 10 11:44:52.982419 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 673/1363] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:52 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:54.002838 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:54.003551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:54.011144 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:54.012311 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:54.012827 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:54.013531 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:54.014102 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:54.014532 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:54.020729 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] [22f9a555-083c-417c-90f7-3503227a9591] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 55836. Aug 10 11:44:54.148188 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:54.155752 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-46cdd314-d627-45b6-8708-7ac7369428e7 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1460 microversion: 2.1 time: 0.156948 Aug 10 11:44:54.156333 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 691/1364] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:53 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1460 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:44:54.298729 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-723ecbbc-9061-450b-bb45-9a27a5ea28e2 req-9bbc81c6-306e-48a3-87dc-ec6419436869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b61bca4-80e0-498d-9c13-754349e9675d", "name": "network-vif-deleted", "tag": "e008a203-743c-469d-8c02-1ad5651ae3fd"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:54.308425 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-723ecbbc-9061-450b-bb45-9a27a5ea28e2 req-9bbc81c6-306e-48a3-87dc-ec6419436869 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:54.308892 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-723ecbbc-9061-450b-bb45-9a27a5ea28e2 req-9bbc81c6-306e-48a3-87dc-ec6419436869 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:54.309314 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-723ecbbc-9061-450b-bb45-9a27a5ea28e2 req-9bbc81c6-306e-48a3-87dc-ec6419436869 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:54.320429 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-723ecbbc-9061-450b-bb45-9a27a5ea28e2 req-9bbc81c6-306e-48a3-87dc-ec6419436869 service nova] Creating event network-vif-deleted:e008a203-743c-469d-8c02-1ad5651ae3fd for instance 4b61bca4-80e0-498d-9c13-754349e9675d on hv-cinder-85061 Aug 10 11:44:54.325412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-723ecbbc-9061-450b-bb45-9a27a5ea28e2 req-9bbc81c6-306e-48a3-87dc-ec6419436869 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 Aug 10 11:44:54.325981 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 674/1365] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:55.177145 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:55.177682 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:55.183910 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:55.184419 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:55.184856 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:55.185536 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:55.185983 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:55.186406 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:55.220175 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:55.220652 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:55.221082 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:55.221774 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.objects.instance [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lazy-loading 'fault' on Instance uuid 4b61bca4-80e0-498d-9c13-754349e9675d {{(pid=118425) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:44:55.260763 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:44:55.269225 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9fd97ca5-57cb-4aaa-8cc6-01ff6082e2bb tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 200 len: 1231 microversion: 2.1 time: 0.096155 Aug 10 11:44:55.269786 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 692/1366] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:55 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:44:56.291790 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:56.292558 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 4b61bca4-80e0-498d-9c13-754349e9675d] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:56.298641 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:56.300331 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:56.300776 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:56.301513 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:56.301958 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:56.302378 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:56.316452 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] HTTP exception thrown: Instance 4b61bca4-80e0-498d-9c13-754349e9675d could not be found. Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Request method failure captured: Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d HTTP/1.1 Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85hOwvmxVhcGa4qzC8lfbcOjbuRtVqDwFwDmKgLYC_amuXrpCjV4XyGK-j9HapFZlwQtxBhqcG2S4MhfcE4XIrj1BfPM_Zt5OAhDNBQjXRU5UavI2VmzX_DmBAg_Q91y9_iYuW5RIcXeBtiiT2Vz_Bjqux09EJJiMlpK4PYb5RmmjYA Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:44:56.318018 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-TestVolumeBootPattern-298050020 Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 63e9c06c2c4f4caabf6ecd67cece94f4 Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 4b61bca4-80e0-498d-9c13-754349e9675d could not be found. Aug 10 11:44:56.319810 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '4b61bca4-80e0-498d-9c13-754349e9675d'} Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b61bca4-80e0-498d-9c13-754349e9675d could not be found. Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:44:56.320993 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b61bca4-80e0-498d-9c13-754349e9675d could not be found. Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b61bca4-80e0-498d-9c13-754349e9675d could not be found. Aug 10 11:44:56.322696 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:44:56.324432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Returning 404 to user: Instance 4b61bca4-80e0-498d-9c13-754349e9675d could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:44:56.324432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-1ae4925a-376b-44ca-8996-b37c2710fe40 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d" status: 404 len: 111 microversion: 2.1 time: 0.032227 Aug 10 11:44:56.324432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 675/1367] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:56 2022] GET /compute/v2.1/servers/4b61bca4-80e0-498d-9c13-754349e9675d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:44:59.661779 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:59.662299 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:59.662939 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-76e7c380-176c-49f6-b786-e041171cbe9c req-12b0c349-e80a-48b8-bae2-4586e13279f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1fd7e13-e433-48a7-acbb-ab0b9c71c750", "tag": "9fa0ea15-40a4-497c-89a3-e9355dd0a419"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:44:59.668812 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:59.669574 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:59.670278 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:59.671039 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:59.671689 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:59.672337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:59.672829 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-76e7c380-176c-49f6-b786-e041171cbe9c req-12b0c349-e80a-48b8-bae2-4586e13279f6 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:59.673300 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-76e7c380-176c-49f6-b786-e041171cbe9c req-12b0c349-e80a-48b8-bae2-4586e13279f6 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:59.673727 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-76e7c380-176c-49f6-b786-e041171cbe9c req-12b0c349-e80a-48b8-bae2-4586e13279f6 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:59.685153 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-76e7c380-176c-49f6-b786-e041171cbe9c req-12b0c349-e80a-48b8-bae2-4586e13279f6 service nova] Creating event network-changed:9fa0ea15-40a4-497c-89a3-e9355dd0a419 for instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 on hv-cinder-85061 Aug 10 11:44:59.690767 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-76e7c380-176c-49f6-b786-e041171cbe9c req-12b0c349-e80a-48b8-bae2-4586e13279f6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031460 Aug 10 11:44:59.694991 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 676/1368] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:44:59.699654 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Going to try to terminate instance {{(pid=118425) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 11:44:59.964351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-f316eac5-02f6-4446-85d9-ba71b8c83966 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 204 len: 0 microversion: 2.1 time: 0.307055 Aug 10 11:44:59.965251 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 693/1369] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:44:59 2022] DELETE /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 11:44:59.974878 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:44:59.975651 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:44:59.981908 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:59.982395 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:59.982821 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:44:59.983512 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:44:59.983964 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:44:59.984531 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:00.124853 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:00.133626 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-2d35d186-10bd-4265-a179-6aa4cbba1d52 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1576 microversion: 2.1 time: 0.163972 Aug 10 11:45:00.134290 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 677/1370] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:44:59 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:01.155486 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:01.156218 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:01.163826 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:01.164337 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:01.165070 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:01.165761 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:01.166208 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:01.166624 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:01.299923 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:01.307894 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-0b916d0c-e1cf-4d90-bb44-3e80c6855cba tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1576 microversion: 2.1 time: 0.156917 Aug 10 11:45:01.308551 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 694/1371] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:01 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:02.302764 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [req-5033c100-d758-451b-9687-8d0dd25c856b req-9f41ebef-5aa8-4f22-be5c-293866320719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1fd7e13-e433-48a7-acbb-ab0b9c71c750", "name": "network-vif-deleted", "tag": "9fa0ea15-40a4-497c-89a3-e9355dd0a419"}]} {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 11:45:02.312491 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-5033c100-d758-451b-9687-8d0dd25c856b req-9f41ebef-5aa8-4f22-be5c-293866320719 service nova] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:02.318210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-5033c100-d758-451b-9687-8d0dd25c856b req-9f41ebef-5aa8-4f22-be5c-293866320719 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:02.318210 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [req-5033c100-d758-451b-9687-8d0dd25c856b req-9f41ebef-5aa8-4f22-be5c-293866320719 service nova] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:02.324858 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.compute.server_external_events [req-5033c100-d758-451b-9687-8d0dd25c856b req-9f41ebef-5aa8-4f22-be5c-293866320719 service nova] Creating event network-vif-deleted:9fa0ea15-40a4-497c-89a3-e9355dd0a419 for instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 on hv-cinder-85061 Aug 10 11:45:02.329966 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [req-5033c100-d758-451b-9687-8d0dd25c856b req-9f41ebef-5aa8-4f22-be5c-293866320719 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031429 Aug 10 11:45:02.330230 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:02.330730 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 678/1372] 10.222.0.13 () {64 vars in 1317 bytes} [Wed Aug 10 11:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 11:45:02.331048 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:02.337694 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:02.338170 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:02.338625 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:02.339351 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:02.339796 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:02.340239 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:02.402449 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.policy [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118425) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:02.409942 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-6dbf1c79-bad4-4493-816f-7fed24745576 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1391 microversion: 2.1 time: 0.084056 Aug 10 11:45:02.411020 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 695/1373] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:02 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1391 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 11:45:03.432588 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:03.433270 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:03.439436 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:03.439916 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:03.440382 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:03.441067 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:03.441568 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:03.441991 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:03.472369 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:03.472839 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:03.474359 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:03.474812 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.objects.instance [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lazy-loading 'fault' on Instance uuid d1fd7e13-e433-48a7-acbb-ab0b9c71c750 {{(pid=118426) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 11:45:03.519742 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.policy [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63e9c06c2c4f4caabf6ecd67cece94f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8775e002af14ee2ac9d6601a6872dfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118426) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 11:45:03.527990 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-5038f33b-fcb8-45af-9626-7053cb02b478 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 200 len: 1230 microversion: 2.1 time: 0.100331 Aug 10 11:45:03.528618 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 679/1374] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:03 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 11:45:04.550672 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:04.551952 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: d1fd7e13-e433-48a7-acbb-ab0b9c71c750] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:04.559344 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:04.559877 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:04.560402 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:04.561220 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:04.561706 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:04.562210 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:04.579298 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] HTTP exception thrown: Instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 could not be found. Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Request method failure captured: Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 HTTP/1.1 Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85hOwvmxVhcGa4qzC8lfbcOjbuRtVqDwFwDmKgLYC_amuXrpCjV4XyGK-j9HapFZlwQtxBhqcG2S4MhfcE4XIrj1BfPM_Zt5OAhDNBQjXRU5UavI2VmzX_DmBAg_Q91y9_iYuW5RIcXeBtiiT2Vz_Bjqux09EJJiMlpK4PYb5RmmjYA Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:45:04.580933 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 63e9c06c2c4f4caabf6ecd67cece94f4 Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 could not be found. Aug 10 11:45:04.582678 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': 'd1fd7e13-e433-48a7-acbb-ab0b9c71c750'} Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 could not be found. Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:45:04.583825 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 could not be found. Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 could not be found. Aug 10 11:45:04.585528 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:04.587126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Returning 404 to user: Instance d1fd7e13-e433-48a7-acbb-ab0b9c71c750 could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:45:04.587126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-9f0a00b8-efe7-4557-99da-499a58ceafce tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750" status: 404 len: 111 microversion: 2.1 time: 0.036093 Aug 10 11:45:04.587126 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 696/1375] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:04 2022] GET /compute/v2.1/servers/d1fd7e13-e433-48a7-acbb-ab0b9c71c750 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:45:05.337068 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:05.337571 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.compute.api [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118426) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:05.343804 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:05.344312 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:05.344743 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:05.345412 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:05.345855 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:05.346273 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG oslo_concurrency.lockutils [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:05.362975 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.wsgi [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] HTTP exception thrown: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Request method failure captured: Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: request: DELETE /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf HTTP/1.1 Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept: application/json Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Accept-Encoding: identity Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Connection: close Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Length: 0 Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Content-Type: application/json Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Host: 10.222.0.13 Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Openstack-System-Scope: None Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: User-Agent: python-urllib3/1.26.11 Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Auth-Token: gAAAAABi85hOwvmxVhcGa4qzC8lfbcOjbuRtVqDwFwDmKgLYC_amuXrpCjV4XyGK-j9HapFZlwQtxBhqcG2S4MhfcE4XIrj1BfPM_Zt5OAhDNBQjXRU5UavI2VmzX_DmBAg_Q91y9_iYuW5RIcXeBtiiT2Vz_Bjqux09EJJiMlpK4PYb5RmmjYA Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Id: None Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Domain-Name: None Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Identity-Status: Confirmed Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Is-Admin-Project: True Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Id: default Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Domain-Name: Default Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Project-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Role: member,reader Aug 10 11:45:05.365209 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Roles: member,reader Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-Tenant-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Id: default Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Domain-Name: Default Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Id: 63e9c06c2c4f4caabf6ecd67cece94f4 Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: X-User-Name: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: method: > Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: exception: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.366899 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: action_args: {'id': '436b2015-f279-44db-9913-99eac99179bf'} Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:45:05.367792 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.369185 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.370970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Returning 404 to user: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. {{(pid=118426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:45:05.370970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-783de277-4b58-4f40-9a5d-22a169a91b4c tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "DELETE /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 404 len: 111 microversion: 2.1 time: 0.034442 Aug 10 11:45:05.370970 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 680/1376] 10.222.0.13 () {58 vars in 1239 bytes} [Wed Aug 10 11:45:05 2022] DELETE /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 11:45:05.375103 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '>' {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:05.375703 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.compute.api [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] [instance: 436b2015-f279-44db-9913-99eac99179bf] Fetching instance by UUID {{(pid=118425) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 11:45:05.382283 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:05.382756 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:05.383185 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:05.383864 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Acquiring lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 11:45:05.384336 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 11:45:05.384754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG oslo_concurrency.lockutils [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Lock "12429ae4-bffe-42b6-ae28-ec7e5a24c80c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118425) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 11:45:05.398889 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.wsgi [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] HTTP exception thrown: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Request method failure captured: Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: request: GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf HTTP/1.1 Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept: application/json Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Accept-Encoding: identity Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Connection: close Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Length: 0 Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Content-Type: application/json Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Host: 10.222.0.13 Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Openstack-System-Scope: None Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: User-Agent: python-urllib3/1.26.11 Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Auth-Token: gAAAAABi85hOwvmxVhcGa4qzC8lfbcOjbuRtVqDwFwDmKgLYC_amuXrpCjV4XyGK-j9HapFZlwQtxBhqcG2S4MhfcE4XIrj1BfPM_Zt5OAhDNBQjXRU5UavI2VmzX_DmBAg_Q91y9_iYuW5RIcXeBtiiT2Vz_Bjqux09EJJiMlpK4PYb5RmmjYA Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Id: None Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Domain-Name: None Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Identity-Status: Confirmed Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Is-Admin-Project: True Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Id: default Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Domain-Name: Default Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Project-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Role: member,reader Aug 10 11:45:05.400422 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Roles: member,reader Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e8775e002af14ee2ac9d6601a6872dfa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Id: e8775e002af14ee2ac9d6601a6872dfa Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-Tenant-Name: tempest-TestVolumeBootPattern-298050020 Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Id: default Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Domain-Name: Default Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Id: 63e9c06c2c4f4caabf6ecd67cece94f4 Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: X-User-Name: tempest-TestVolumeBootPattern-298050020-project Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: method: > Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: exception: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.402112 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: action_args: {'id': '436b2015-f279-44db-9913-99eac99179bf'} Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: {{(pid=118425) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 11:45:05.403062 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. Aug 10 11:45:05.404754 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: ERROR nova.api.openstack.wsgi Aug 10 11:45:05.406514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: DEBUG nova.api.openstack.wsgi [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Returning 404 to user: Instance 436b2015-f279-44db-9913-99eac99179bf could not be found. {{(pid=118425) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 11:45:05.406514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO nova.api.openstack.requestlog [None req-ee7dc461-7044-497a-a2bb-30927ebc9838 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf" status: 404 len: 111 microversion: 2.1 time: 0.030395 Aug 10 11:45:05.406514 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: [pid: 118425|app: 0|req: 697/1377] 10.222.0.13 () {58 vars in 1236 bytes} [Wed Aug 10 11:45:05 2022] GET /compute/v2.1/servers/436b2015-f279-44db-9913-99eac99179bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 11:45:06.952236 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: DEBUG nova.api.openstack.wsgi [None req-d1b77d06-cf15-4662-b3b8-ff15a3616432 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] Calling method '.version_select at 0x7f6f49014ee0>' {{(pid=118426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 11:45:07.102319 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO nova.api.openstack.requestlog [None req-d1b77d06-cf15-4662-b3b8-ff15a3616432 tempest-TestVolumeBootPattern-298050020 tempest-TestVolumeBootPattern-298050020-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1626919928" status: 202 len: 0 microversion: 2.1 time: 0.154141 Aug 10 11:45:07.102926 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: [pid: 118426|app: 0|req: 681/1378] 10.222.0.13 () {58 vars in 1263 bytes} [Wed Aug 10 11:45:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1626919928 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 11:45:59.387162 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:45:59.387648 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:45:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:46:04.480577 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:46:04.481205 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:47:41.920612 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:47:41.921212 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Wed Aug 10 11:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:47:58.719028 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:47:58.719728 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Wed Aug 10 11:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:47:59.203432 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:47:59.203643 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Wed Aug 10 11:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:48:03.839865 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:48:03.840474 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:48:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:49:19.396883 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:49:19.397453 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:49:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:49:24.488565 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:49:24.489115 dv-cinder-850618-2-iscsi devstack@n-api.service[118425]: Wed Aug 10 11:49:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 11:51:01.928121 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 11:51:01.928720 dv-cinder-850618-2-iscsi devstack@n-api.service[118426]: Wed Aug 10 11:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!